00000001:02000400:1.0F:1788625544.824779:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788625565.750402:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788625568.172010:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 350 MB/s 00000001:01000000:1.0:1788625568.422785:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 370 MB/s 00000001:01000000:1.0:1788625568.672818:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2043 MB/s 00000020:02000000:3.0F:1788625569.675586:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g69c2166 00000400:02000000:2.0:1788625570.976021:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.145@tcp [8/256/0/180] 00008000:02000000:2.0:1788625575.024239:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788625631.024601:0:5252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788625641.629929:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625641.629936:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788625641.630081:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009e25857c 00000080:02000400:2.0:1788625641.630092:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788625641.639646:0:5822:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788625641.639927:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788625641.639970:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001107886d) 00000020:00000080:2.0:1788625641.639992:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788625641.670023:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788625641.671050:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788625641.722651:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788625641.722701:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788625641.722756:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788625641.722807:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788625641.722832:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788625641.723093:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788625641.723102:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788625641.723113:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb133ad 00000020:01000004:0.0:1788625641.723121:0:5822:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788625641.723125:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788625641.723128:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009e25857c from MGS 00000020:01000004:0.0:1788625641.723131:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788625641.723145:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009f97ca4a) 00000020:00000080:0.0:1788625641.723155:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788625641.723228:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009e25857c from MGS, refs=2 00080000:01000000:0.0:1788625641.723232:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625641.723235:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb133bb 00000100:00100000:0.0:1788625641.723329:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788625641.723422:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788625641.723426:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788625641.724646:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788625641.724714:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788625641.726336:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625641.726506:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788625641.726511:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788625641.728134:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788625641.728145:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788625641.728547:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788625641.728553:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788625641.729519:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625641.729524:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625641.729525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625641.730177:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625641.730180:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625641.730182:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625641.731213:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788625641.734493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788625641.981337:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2147 MB/s 00000001:01000000:3.0:1788625642.234112:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3547 MB/s 00000001:01000000:2.0:1788625642.484473:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 567 MB/s 00000001:01000000:3.0:1788625642.734305:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 387 MB/s 00010000:00010000:2.0:1788625642.739759:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788625642.744770:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788625642.766077:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788625642.766095:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788625642.766097:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788625642.766618:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788625642.766669:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788625642.766719:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788625642.766892:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788625642.766928:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788625642.767248:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625642.767395:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788625642.767401:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788625642.773381:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788625642.773394:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788625642.773690:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788625642.773696:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788625642.774466:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788625642.774488:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:3.0:1788625642.774490:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788625642.774543:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:3.0:1788625642.774562:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (0000000071533c6d) 00000020:00000080:3.0:1788625642.774580:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788625642.774703:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b97f03b1@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1788625642.776409:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:1.0:1788625642.776418:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788625642.776662:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788625642.776991:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788625642.777053:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c) 00000020:00000080:0.0:1788625642.777073:0:5822:0:(genops.c:1385:class_connect()) connect: client d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c, cookie 0x8aede7274cb133c9 00000100:00080000:0.0:1788625642.777103:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625642.777108:0:5822:0:(import.c:665:import_select_connection()) MGC192.168.201.145@tcp: import 00000000b97f03b1 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625642.777149:0:5822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d3e9066 x1875509845688448/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625642.777176:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c->MGS 00000020:01000004:0.0:1788625642.777199:0:5822:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788625642.777205:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788625642.777223:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b8e76342) 00000020:00000080:0.0:1788625642.777244:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788625642.777380:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d3e9066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3307:1875509845688448:0@lo:250: 00000100:00100000:3.0:1788625642.777464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625642.784264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845688448 00000100:00100000:3.0:1788625642.784279:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845688448 00000100:00100000:3.0:1788625642.784337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625642.784345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000639c8f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3307:x1875509845688448:12345-0@lo:250: 00010000:00080000:3.0:1788625642.784375:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1788625642.784421:0:5835:0:(genops.c:1385:class_connect()) connect: client d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c, cookie 0x8aede7274cb133d7 00000100:00080000:3.0:1788625642.784562:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000c9a63429 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625642.784642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000639c8f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:3307:x1875509845688448:12345-0@lo:250: Request processed in 297us (7178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625642.784650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625642.784701:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788625642.784711:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1788625642.784720:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788625642.784724:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788625642.784746:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000b97f03b1 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788625642.784749:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788625642.784758:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788625642.784763:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d3e9066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3307:1875509845688448:0@lo:250: 00000100:00100000:0.0:1788625642.796828:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625642.797267:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788625642.797275:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788625642.798261:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788625642.798270:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788625642.798612:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625642.798617:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788625642.799651:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625642.800081:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788625642.800087:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788625642.800561:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788625642.800574:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788625642.855332:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625642.855525:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788625642.855531:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788625642.859457:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788625642.859473:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788625642.860382:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625642.860609:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788625642.860615:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788625642.861179:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625642.861185:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788625642.861757:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625642.861903:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625642.861908:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788625642.863048:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625642.863057:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788625642.867427:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625642.867650:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625642.867656:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788625642.868660:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625642.868668:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788625642.907530:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625642.908443:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625642.908450:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788625642.912462:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788625642.912477:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788625642.915121:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625642.915135:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788625642.919027:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788625642.919054:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788625642.919133:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788625642.919290:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788625642.919324:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788625642.919328:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788625642.919330:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625642.919334:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625642.919335:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625642.919337:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625642.919338:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625642.919339:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625642.919340:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625642.919342:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625642.919343:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625642.919344:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625642.919345:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625642.919347:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788625642.919349:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788625642.919350:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625642.919351:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625642.919352:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625642.919353:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625642.919354:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625642.919355:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625642.919356:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625642.919357:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625642.919357:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625642.919358:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625642.919359:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625642.919395:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788625642.919414:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688576:0@lo:253: 00000100:00100000:1.0:1788625642.919658:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625642.919788:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063a5d7fc going to sleep for 11 seconds 00000100:00100000:3.0:1788625642.919971:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845688576 00000100:00100000:3.0:1788625642.919980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845688576 00000100:00100000:3.0:1788625642.920073:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625642.920081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a433be9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5822:x1875509845688576:12345-0@lo:253: 20000000:01000000:3.0:1788625642.920128:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788625642.920131:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788625642.920507:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788625642.920708:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788625642.921179:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625642.925008:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788625642.925337:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788625642.925342:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788625642.925348:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788625642.925351:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788625642.925366:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788625642.925871:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625642.926246:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788625642.926263:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788625642.926309:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788625642.926359:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788625642.926397:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788625642.926642:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788625642.926654:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788625642.926706:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788625642.926715:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788625642.927205:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788625642.927217:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788625642.927261:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788625642.927310:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788625642.927368:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788625642.927376:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788625642.927391:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625642.928008:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788625642.928020:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788625642.928145:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788625642.928185:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788625642.928248:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788625642.928262:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788625642.928350:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788625642.928359:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788625642.928406:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788625642.928445:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788625642.928479:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788625642.928684:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788625642.928946:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788625642.928958:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788625642.928995:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788625642.929049:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788625642.929320:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788625642.929367:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788625642.929374:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788625642.930290:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788625642.930714:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788625642.930852:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.145@tcp for mdt 20000000:01000000:3.0:1788625642.930854:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788625642.930889:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788625642.930896:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788625642.930939:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788625642.930946:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1788625642.931017:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788625642.931027:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788625642.931056:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788625642.931084:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788625642.931145:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788625642.931148:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788625642.931154:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788625642.931160:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788625642.932051:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788625642.932184:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788625642.948984:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788625642.949329:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788625642.949412:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788625642.949432:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788625642.949434:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788625642.949438:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788625642.949450:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788625642.949452:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788625642.949483:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788625642.949485:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788625642.951143:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788625642.953794:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788625642.953850:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788625642.953883:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788625642.953896:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788625642.953898:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788625642.954409:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788625642.954642:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788625642.954683:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788625642.954797:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1788625642.954813:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788625642.954815:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788625642.954824:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788625642.954848:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954866:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954876:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954883:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954890:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954896:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954902:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd7d1416 already unused, calling callback (00000000b24f944b) 00010000:00010000:3.0:1788625642.954906:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954913:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954925:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954932:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625642.954937:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788625642.954966:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788625643.196592:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a433be9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5822:x1875509845688576:12345-0@lo:253: Request processed in 276504us (277092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625643.196606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625643.196712:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688576:0@lo:253: 10000000:01000000:1.0:1788625643.196759:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788625643.196763:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625643.196765:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625643.196781:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625643.196782:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788625643.196783:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625643.196785:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625643.196786:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625643.196787:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625643.196789:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788625643.196790:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625643.196792:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788625643.196813:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009e25857c from lustre-MDT0000 10000000:01000000:1.0:1788625643.196939:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788625643.196943:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788625643.196947:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b4346390000 10000000:01000000:1.0:1788625643.196951:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625643.196959:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b4346390000 from 1 10000000:01000000:1.0:1788625643.196962:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788625643.196999:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.197009:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.197018:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.197092:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688704:0@lo:101: 00000100:00100000:1.0:1788625643.197130:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.197225:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:3.0:1788625643.197350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845688704 00000100:00100000:3.0:1788625643.197358:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845688704 00000100:00100000:3.0:1788625643.197441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625643.197449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4456ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5822:x1875509845688704:12345-0@lo:101: 00010000:00010000:3.0:1788625643.197462:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625643.197473:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb133e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625643.197494:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625643.197504:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd7d1416/0x8aede7274cb133ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625643.197512:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd7d1416, rc 0) 00000100:00100000:3.0:1788625643.197552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4456ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+6:5822:x1875509845688704:12345-0@lo:101: Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625643.197558:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625643.197614:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688704:0@lo:101: 00010000:00010000:1.0:1788625643.197626:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.197634:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.197687:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688832:0@lo:501: 00000100:00100000:1.0:1788625643.197712:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.197929:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.198013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845688832 00000100:00100000:2.0:1788625643.198019:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845688832 00000100:00100000:2.0:1788625643.198102:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625643.198110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ecf5279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+6:5822:x1875509845688832:12345-0@lo:501: 00000100:00100000:2.0:1788625643.198366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ecf5279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+6:5822:x1875509845688832:12345-0@lo:501: Request processed in 257us (653us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625643.198374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625643.198456:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688832:0@lo:501: 10000000:01000000:1.0:1788625643.198483:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788625643.198500:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.198508:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000799474cf/0x8aede7274cb133e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625643.198515:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b4346652800 10000000:01000000:1.0:1788625643.198519:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788625643.198524:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b4346652800 10000000:01000000:1.0:1788625643.198525:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788625643.198528:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b4346652800 from 1 10000000:01000000:1.0:1788625643.198530:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788625643.198547:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.198553:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.198560:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.198571:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688960:0@lo:101: 00000100:00100000:1.0:1788625643.198606:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.198618:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.198679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845688960 00000100:00100000:2.0:1788625643.198684:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845688960 00000100:00100000:2.0:1788625643.198703:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625643.198708:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017d1b884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+6:5822:x1875509845688960:12345-0@lo:101: 00010000:00010000:2.0:1788625643.198724:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625643.198753:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9a126c8/0x8aede7274cb133fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb133f3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.198769:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9a126c8/0x8aede7274cb133fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb133f3 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.198777:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9a126c8/0x8aede7274cb133fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb133f3 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.198785:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9a126c8, rc 0) 00000100:00100000:2.0:1788625643.198891:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017d1b884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+7:5822:x1875509845688960:12345-0@lo:101: Request processed in 183us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.198897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625643.199001:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845688960:0@lo:101: 00010000:00010000:1.0:1788625643.199012:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.199019:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625643.199028:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788625643.199049:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.199055:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000009d111822/0x8aede7274cb133f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625643.199061:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788625643.199065:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625643.199069:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b4346652800 10000000:01000000:1.0:1788625643.199071:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788625643.199074:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788625643.199075:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625643.199090:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.199095:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.199100:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.199117:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689088:0@lo:101: 00000100:00100000:1.0:1788625643.199142:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.199161:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.199283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689088 00000100:00100000:2.0:1788625643.199288:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689088 00000100:00100000:2.0:1788625643.199307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625643.199313:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fec73a6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+7:5822:x1875509845689088:12345-0@lo:101: 00010000:00010000:2.0:1788625643.199319:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625643.199327:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020b9f64e/0x8aede7274cb13408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13401 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.199341:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020b9f64e/0x8aede7274cb13408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13401 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.199348:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020b9f64e/0x8aede7274cb13408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13401 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.199354:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020b9f64e, rc 0) 00000100:00100000:2.0:1788625643.199397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fec73a6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+8:5822:x1875509845689088:12345-0@lo:101: Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.199403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625643.199523:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689088:0@lo:101: 00010000:00010000:1.0:1788625643.199533:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.199539:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.199576:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689216:0@lo:501: 00000100:00100000:1.0:1788625643.199600:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.199620:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.199671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689216 00000100:00100000:2.0:1788625643.199675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689216 00000100:00100000:2.0:1788625643.199702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625643.199707:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a76df5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+8:5822:x1875509845689216:12345-0@lo:501: 00000100:00100000:2.0:1788625643.200026:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a76df5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5822:x1875509845689216:12345-0@lo:501: Request processed in 318us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.200098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625643.200177:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689216:0@lo:501: 00000100:00100000:1.0:1788625643.200203:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689344:0@lo:503: 00000100:00100000:1.0:1788625643.200249:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.200277:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003773bb0e going to sleep for 11 seconds 00000100:00100000:3.0:1788625643.200327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689344 00000100:00100000:3.0:1788625643.200332:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689344 00000100:00100000:3.0:1788625643.200361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625643.200367:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047b4856d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5822:x1875509845689344:12345-0@lo:503: 00000100:00100000:3.0:1788625643.200519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047b4856d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5822:x1875509845689344:12345-0@lo:503: Request processed in 152us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625643.200532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625643.200642:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689344:0@lo:503: 00000100:00100000:2.0:1788625643.201796:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c762077 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5865:1875509845689472:0@lo:502: 00000100:00100000:2.0:1788625643.201961:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625643.202089:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 000000009685c698 going to sleep for 11 seconds 00000100:00100000:3.0:1788625643.202130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689472 00000100:00100000:3.0:1788625643.202137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689472 00000100:00100000:3.0:1788625643.202243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625643.202252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aececb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5865:x1875509845689472:12345-0@lo:502: 00000100:00100000:3.0:1788625643.202447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aececb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5865:x1875509845689472:12345-0@lo:502: Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625643.202454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625643.202534:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c762077 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5865:1875509845689472:0@lo:502: 00000020:01000000:0.0:1788625643.202561:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625643.202573:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625643.202575:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788625643.202581:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788625643.202584:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625643.202598:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ea3ce89e) 00000020:00000080:0.0:1788625643.202615:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788625643.202621:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788625643.202697:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788625643.202704:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb13416 00000020:00000080:0.0:1788625643.202957:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788625643.202962:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625643.202965:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625643.202967:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788625643.202969:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625643.202973:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625643.202974:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788625643.202977:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625643.202983:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007ec6bc77) 00000020:00000080:0.0:1788625643.202993:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788625643.202996:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788625643.203004:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788625643.203006:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788625643.203013:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625643.203226:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009e25857c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788625643.203258:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000db24707e) 00000020:00000080:0.0:1788625643.203267:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788625643.203317:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788625643.203322:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb1342b 00000020:00000080:0.0:1788625643.203450:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788625643.203457:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788625643.203461:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8aede7274cb13432 00080000:01000000:0.0:1788625643.203465:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788625643.203468:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb13439 00080000:10000000:0.0:1788625643.204383:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788625643.204620:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788625643.209364:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788625643.338166:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788625643.338553:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788625643.345322:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788625643.345697:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788625643.399235:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004e57f361) 00000020:00000080:2.0:1788625643.399260:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788625643.399344:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788625643.399351:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb13447 00000020:00000080:3.0:1788625643.404356:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788625643.408867:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625643.477939:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625643.546548:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.618267:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.666111:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.732650:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788625643.759535:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8aede7274cb1344e 00000020:00000080:2.0:1788625643.759980:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788625643.759992:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625643.759999:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625643.760001:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788625643.760005:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625643.760011:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625643.760012:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788625643.760016:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788625643.760050:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788625643.760064:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625643.760076:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625643.760078:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788625643.760081:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625643.760084:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625643.760085:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625643.760088:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625643.760090:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625643.760135:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a01e11aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5865:1875509845689600:0@lo:502: 00000100:00100000:2.0:1788625643.760211:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625643.760277:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b39dc555 going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.760447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689600 00000100:00100000:0.0:1788625643.760455:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689600 00000100:00100000:0.0:1788625643.760506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625643.760514:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005823bc61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5865:x1875509845689600:12345-0@lo:502: 00000100:00100000:0.0:1788625643.760773:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005823bc61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5865:x1875509845689600:12345-0@lo:502: Request processed in 259us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.760782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625643.760884:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a01e11aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5865:1875509845689600:0@lo:502: 00000020:01000000:3.0:1788625643.760913:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625643.760918:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625643.760919:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788625643.760923:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788625643.761180:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788625643.761199:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788625643.761229:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.761253:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000023eddd32/0x8aede7274cb13401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625643.761261:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b4346652800 from 1 10000000:01000000:0.0:1788625643.761264:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625643.761293:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.761301:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.761308:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.761322:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689728:0@lo:101: 00000100:00100000:0.0:1788625643.761363:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.761383:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000027ba2b8 going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.761448:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689728 00000100:00100000:2.0:1788625643.761453:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689728 00000100:00100000:2.0:1788625643.761487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625643.761494:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a67f7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:5822:x1875509845689728:12345-0@lo:101: 00010000:00010000:2.0:1788625643.761504:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625643.761517:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13455 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.761537:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13455 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.761547:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13455 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.761556:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093b964cf, rc 0) 00000100:00100000:2.0:1788625643.761584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a67f7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:5822:x1875509845689728:12345-0@lo:101: Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.761590:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625643.761662:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689728:0@lo:101: 00010000:00010000:0.0:1788625643.761675:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.761683:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.762240:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689856:0@lo:256: 00000100:00100000:0.0:1788625643.762280:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.762299:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000027ba2b8 going to sleep for 11 seconds 00010000:00010000:0.0:1788625643.763083:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625643.763097:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689856 00000100:00100000:0.0:1788625643.763105:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689856 00000100:00100000:0.0:1788625643.763139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625643.763147:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f6c745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:5822:x1875509845689856:12345-0@lo:256: 20000000:01000000:0.0:1788625643.763168:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788625643.763174:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788625643.763278:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f6c745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:5822:x1875509845689856:12345-0@lo:256: Request processed in 132us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.763286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625643.763331:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689856:0@lo:256: 10000000:01000000:0.0:1788625643.763947:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625643.763956:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.763965:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625643.763972:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346652800 from 1 10000000:01000000:0.0:1788625643.763975:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625643.764003:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764009:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764016:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.764031:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689984:0@lo:101: 00000100:00100000:0.0:1788625643.764071:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.764097:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000027ba2b8 going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.764114:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845689984 00000100:00100000:0.0:1788625643.764119:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845689984 00000100:00100000:0.0:1788625643.764140:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625643.764145:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000053d5849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:5822:x1875509845689984:12345-0@lo:101: 00010000:00010000:0.0:1788625643.764153:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625643.764163:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13463 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764181:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764190:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764197:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009bb219be, rc 0) 00000100:00100000:0.0:1788625643.764238:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000053d5849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845689984:12345-0@lo:101: Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.764243:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625643.764273:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845689984:0@lo:101: 00010000:00010000:0.0:1788625643.764283:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.764289:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.764331:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690112:0@lo:501: 00000100:00100000:0.0:1788625643.764362:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.764373:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000027ba2b8 going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.764384:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690112 00000100:00100000:0.0:1788625643.764387:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690112 00000100:00100000:0.0:1788625643.764403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625643.764408:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c4afb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845690112:12345-0@lo:501: 00000100:00100000:0.0:1788625643.764810:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c4afb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845690112:12345-0@lo:501: Request processed in 401us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.764817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625643.764877:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690112:0@lo:501: 00000100:00100000:0.0:1788625643.764904:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690240:0@lo:503: 00000100:00100000:0.0:1788625643.764941:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.764959:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000027ba2b8 going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.764971:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690240 00000100:00100000:0.0:1788625643.764975:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690240 00000100:00100000:0.0:1788625643.764993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625643.764998:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e666e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845690240:12345-0@lo:503: 00000040:00080000:0.0:1788625643.765029:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625643.765067:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e666e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845690240:12345-0@lo:503: Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.765073:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625643.765108:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690240:0@lo:503: 00000040:00080000:3.0:1788625643.766281:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788625643.766512:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788625643.766534:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625643.766552:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.766579:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625643.766622:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625643.766625:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b4346652800 10000000:01000000:0.0:1788625643.766628:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b4346652800 10000000:01000000:0.0:1788625643.766632:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625643.766637:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4346652800 from 1 10000000:01000000:0.0:1788625643.766639:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625643.766671:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.766678:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.766687:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.766706:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690368:0@lo:101: 00000100:00100000:0.0:1788625643.766780:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.766810:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c60e64d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788625643.766862:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690368 00000100:00100000:1.0:1788625643.766867:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690368 00000100:00100000:1.0:1788625643.766911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625643.766916:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d4658bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845690368:12345-0@lo:101: 00010000:00010000:1.0:1788625643.766925:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625643.766937:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af41caaa/0x8aede7274cb13478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13471 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.766955:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af41caaa/0x8aede7274cb13478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13471 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.766961:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af41caaa/0x8aede7274cb13478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13471 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.766966:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af41caaa, rc 0) 00000100:00100000:1.0:1788625643.766999:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d4658bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845690368:12345-0@lo:101: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625643.767003:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625643.767174:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690368:0@lo:101: 00010000:00010000:0.0:1788625643.767187:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.767194:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.767259:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690496:0@lo:501: 00000100:00100000:0.0:1788625643.767285:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.767308:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c60e64d1 going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.767357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690496 00000100:00100000:2.0:1788625643.767361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690496 00000100:00100000:2.0:1788625643.767398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625643.767404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0c30b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845690496:12345-0@lo:501: 00000100:00100000:2.0:1788625643.767635:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0c30b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845690496:12345-0@lo:501: Request processed in 231us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.767642:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625643.767770:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690496:0@lo:501: 00000100:00100000:0.0:1788625643.767794:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690624:0@lo:503: 00000100:00100000:0.0:1788625643.767830:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.767858:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c60e64d1 going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.767904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690624 00000100:00100000:2.0:1788625643.767908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690624 00000100:00100000:2.0:1788625643.767941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625643.767947:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8022c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845690624:12345-0@lo:503: 00000100:00100000:2.0:1788625643.768097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8022c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845690624:12345-0@lo:503: Request processed in 150us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.768104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625643.768245:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba5ebb29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845690624:0@lo:503: 00000100:00100000:1.0:1788625643.768592:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5870:1875509845690752:0@lo:502: 00000100:00100000:1.0:1788625643.768631:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.768654:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd54ad64 going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.768700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690752 00000100:00100000:2.0:1788625643.768704:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690752 00000100:00100000:2.0:1788625643.768754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625643.768760:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d7a6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5870:x1875509845690752:12345-0@lo:502: 00000100:00100000:2.0:1788625643.768912:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d7a6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5870:x1875509845690752:12345-0@lo:502: Request processed in 152us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625643.768919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788625643.769160:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5870:1875509845690752:0@lo:502: 00000020:01000004:1.0:1788625643.769210:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788625643.769242:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b34412ab) 00000020:00000080:1.0:1788625643.769261:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788625643.769363:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009e25857c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788625643.769368:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009e25857c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788625643.769370:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009e25857c 4 00010000:00080000:1.0:1788625643.769398:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c520928e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1788625643.775675:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788625643.776249:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788625643.776289:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625643.776301:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8aede7274cb13486 00000100:00080000:0.0:1788625643.776310:0:5870:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625643.776316:0:5870:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c520928e using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625643.776355:0:5870:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000043d7a7ab x1875509845690880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625643.776382:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788625643.776636:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845690880:0@lo:38: 00000100:00100000:3.0:1788625643.776717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.776893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845690880 00000100:00100000:0.0:1788625643.776901:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845690880 00000100:00100000:0.0:1788625643.776943:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625643.776949:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8223dd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845690880:12345-0@lo:38: 00000100:00100000:0.0:1788625643.777004:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8223dd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845690880:12345-0@lo:38: Request processed in 54us (287us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788625643.777012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625643.777568:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625643.777576:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000c520928e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625643.777589:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788625643.777593:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845690880:0@lo:38: 00000100:00100000:0.0:1788625643.777691:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5870:1875509845691008:0@lo:502: 00000100:00100000:0.0:1788625643.777774:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.777804:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691008 00000100:00100000:0.0:1788625643.777808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691008 00000100:00100000:0.0:1788625643.777839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625643.777845:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012de4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5870:x1875509845691008:12345-0@lo:502: 00000100:00100000:0.0:1788625643.778560:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012de4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5870:x1875509845691008:12345-0@lo:502: Request processed in 713us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.778569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625643.778672:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd7d5dd going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.778688:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5870:1875509845691008:0@lo:502: 00000040:00080000:0.0:1788625643.778715:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788625643.783148:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788625643.783191:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625643.783227:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625643.783242:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000fcb26a04/0x8aede7274cb13471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625643.783361:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625643.783365:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625643.783367:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625643.783368:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625643.783370:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625643.783371:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625643.783372:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625643.783373:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625643.783374:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625643.783376:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625643.783377:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625643.783379:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625643.783382:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788625643.783385:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625643.783386:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625643.783387:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625643.783388:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625643.783389:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625643.783397:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625643.783397:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625643.783398:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625643.783399:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625643.783400:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625643.783400:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625643.783402:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625643.783431:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625643.783448:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845691136:0@lo:253: 00000100:00100000:0.0:1788625643.783546:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.783594:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd7d5dd going to sleep for 11 seconds 00000100:00100000:2.0:1788625643.785154:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691136 00000100:00100000:2.0:1788625643.785172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691136 00000100:00100000:2.0:1788625643.785243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625643.785252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009be42004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5822:x1875509845691136:12345-0@lo:253: 20000000:01000000:2.0:1788625643.785286:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625643.785304:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788625643.824691:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788625643.824709:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788625643.824875:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625643.824881:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625643.824901:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.824938:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13455 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.824947:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.824986:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625643.825000:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 12 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625643.825013:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845691264:0@lo:104: 00000100:00100000:1.0:1788625643.825247:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625643.825306:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd54ad64 going to sleep for 11 seconds 00000100:00100000:0.0:1788625643.825399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691264 00000100:00100000:0.0:1788625643.825407:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691264 00000100:00100000:0.0:1788625643.825458:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625643.825466:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002694d463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845691264:12345-0@lo:104: 00010000:00010000:0.0:1788625643.825479:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825531:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625643.825536:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002694d463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845691264:12345-0@lo:104: Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.825542:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788625643.825564:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625643.825568:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825577:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b511dc87 already unused, calling callback (0000000082f673db) 10000000:00010000:0.0:1788625643.825579:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825597:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625643.825603:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625643.825608:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625643.825637:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825643:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625643.825657:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825663:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000b511dc87/0x8aede7274cb13455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1345c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825680:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625643.825681:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625643.825683:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625643.825767:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000990c4fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845691392:0@lo:103: 00000100:00100000:0.0:1788625643.825796:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625643.825857:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691392 00000100:00100000:0.0:1788625643.825861:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691392 00010000:00010000:0.0:1788625643.825875:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 13 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.825896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625643.825902:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e397b45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845691392:12345-0@lo:103: 00010000:00010000:0.0:1788625643.825918:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625643.825922:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 13 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825932:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 13 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825947:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825953:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625643.825965:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001086033s 00010000:00010000:0.0:1788625643.825968:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825974:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825980:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825985:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.825991:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba185248 already unused, calling callback (00000000b24f944b) 00010000:00010000:0.0:1788625643.825995:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826001:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826014:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826235:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625643.826263:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e397b45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845691392:12345-0@lo:103: Request processed in 362us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625643.826270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625643.826304:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000990c4fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845691392:0@lo:103: 00010000:00010000:0.0:1788625643.826330:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000093b964cf/0x8aede7274cb1345c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13455 expref: 12 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625643.826339:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d927c18e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845691264:0@lo:104: 00010000:00010000:0.0:1788625643.826350:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826358:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826363:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625643.826368:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba185248/0x8aede7274cb1348d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625643.847310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009be42004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5822:x1875509845691136:12345-0@lo:253: Request processed in 62051us (63757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625643.847328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625643.849287:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043d7a7ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5822:1875509845691136:0@lo:253: 10000000:01000000:1.0:1788625643.849308:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788625643.849311:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625643.849313:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625643.849314:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625643.849316:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625643.849317:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625643.849319:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625643.849320:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625643.849322:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625643.849323:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625643.849324:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625643.849325:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625643.849326:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788625643.849342:0:5822:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788625643.862827:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.863413:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625643.863634:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.863894:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625643.864463:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.864667:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625643.865647:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.865863:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625643.866095:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.866301:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625643.866637:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625643.866947:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788625643.979770:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788625644.027781:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788625644.028237:0:5875:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788625644.028242:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788625644.028302:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788625644.031807:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788625644.031992:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788625644.032487:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788625644.032496:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788625644.032634:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625644.036644:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788625644.042436:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788625644.042510:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788625644.042801:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788625644.042989:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788625644.047157:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788625644.053550:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788625644.053813:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788625644.053984:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788625644.054141:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788625644.054318:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788625644.054480:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788625644.054632:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788625644.054813:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788625644.054952:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788625644.055099:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788625644.055275:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788625644.055392:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788625644.055520:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788625644.055658:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788625644.055844:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788625644.056145:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788625644.061538:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788625644.061779:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788625644.061958:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788625644.062470:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788625644.062630:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788625644.062799:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788625644.062942:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788625644.063307:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788625644.063428:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788625644.063550:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788625644.063699:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788625644.067700:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788625644.067880:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788625644.070376:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788625644.070619:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788625644.070893:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788625644.087079:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788625644.165009:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788625644.165057:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdd8c1bcf988 00100000:10000000:2.0:1788625644.165066:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788625644.166314:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788625644.166330:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788625644.166344:0:5822:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788625644.166362:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788625644.219596:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788625644.219691:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788625644.219696:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788625644.787823:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625645.810844:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625646.834989:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625647.861497:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625648.884057:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625649.138880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625649.138892:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788625649.138897:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c520928e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625649.138914:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c520928e using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625649.138941:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003dd8ba74 x1875509845691648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625649.138989:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003dd8ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845691648:0@lo:38: 00000100:00100000:2.0:1788625649.139085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625649.139198:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691648 00000100:00100000:2.0:1788625649.139217:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691648 00000100:00100000:2.0:1788625649.139257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625649.139264:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ce48815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875509845691648:12345-0@lo:38: 00010000:00080000:2.0:1788625649.139292:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1788625649.139339:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8aede7274cb13494 00000004:00100000:2.0:1788625649.139395:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788625649.139547:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000156a908d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625649.139614:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ce48815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875509845691648:12345-0@lo:38: Request processed in 349us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625649.139623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788625649.139678:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003dd8ba74 x1875509845691648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625649.139696:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788625649.139704:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788625649.139709:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788625649.139711:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000c520928e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625649.139718:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003dd8ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845691648:0@lo:38: 00000100:00100000:1.0:1788625649.139763:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845691520:0@lo:400: 00000100:00100000:1.0:1788625649.139839:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625649.140950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691520 00000100:00100000:2.0:1788625649.140964:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691520 00000100:00100000:2.0:1788625649.141023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625649.141032:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aeb656c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:3310:x1875509845691520:12345-0@lo:400: 00000100:00100000:2.0:1788625649.141112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aeb656c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:3310:x1875509845691520:12345-0@lo:400: Request processed in 82us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625649.141120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625649.141260:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845691520:0@lo:400: 00000001:02000400:3.0:1788625649.479646:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788625649.650986:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788625649.650998:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b4346652800 from 3 10000000:01000000:1.0:1788625649.651006:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788625649.651078:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.651094:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.651108:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625649.651166:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024d74f8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845691776:0@lo:101: 00000100:00100000:1.0:1788625649.651258:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625649.651316:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f678d99a going to sleep for 11 seconds 00000100:00100000:1.0:1788625649.651340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691776 00000100:00100000:1.0:1788625649.651350:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691776 00000100:00100000:1.0:1788625649.651413:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625649.651424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082cc44fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5838:x1875509845691776:12345-0@lo:101: 00010000:00010000:1.0:1788625649.651442:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625649.651460:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000396213a1/0x8aede7274cb134a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1349b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.651488:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000396213a1/0x8aede7274cb134a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1349b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.651499:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000396213a1/0x8aede7274cb134a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1349b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.651509:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000396213a1, rc 0) 00000100:00100000:1.0:1788625649.651564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082cc44fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845691776:12345-0@lo:101: Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625649.651571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625649.652213:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024d74f8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845691776:0@lo:101: 00010000:00010000:0.0:1788625649.652235:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625649.652246:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625649.652315:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000990c4fcd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845691904:0@lo:256: 00000100:00100000:0.0:1788625649.652360:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625649.652386:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd2672f4 going to sleep for 11 seconds 00000100:00100000:1.0:1788625649.652633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845691904 00000100:00100000:1.0:1788625649.652640:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845691904 00000100:00100000:1.0:1788625649.652680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625649.652688:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d67e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845691904:12345-0@lo:256: 20000000:01000000:1.0:1788625649.652706:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625649.652725:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625649.652760:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788625649.652863:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d67e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845691904:12345-0@lo:256: Request processed in 176us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625649.652870:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625649.652908:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000990c4fcd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845691904:0@lo:256: 10000000:01000000:1.0:1788625649.652954:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788625649.652961:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625649.652970:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000098f898a4/0x8aede7274cb1349b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625649.906930:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625650.932065:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625651.954981:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625652.980390:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625654.003342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625654.263949:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003dd8ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845692160:0@lo:400: 00000100:00100000:2.0:1788625654.264082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625654.264232:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625654.264244:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845692032:0@lo:400: 00000100:00100000:1.0:1788625654.264306:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625654.264600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692032 00000100:00100000:2.0:1788625654.264611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692032 00000100:00100000:2.0:1788625654.264679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625654.264689:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000894621e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3310:x1875509845692032:12345-0@lo:400: 00000100:00100000:2.0:1788625654.264788:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000894621e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3310:x1875509845692032:12345-0@lo:400: Request processed in 101us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625654.264797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625654.264861:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845692032:0@lo:400: 00000100:00100000:3.0:1788625654.265300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692160 00000100:00100000:3.0:1788625654.265308:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692160 00000100:00100000:3.0:1788625654.265348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625654.265355:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046ad9382 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845692160:12345-0@lo:400: 00000100:00100000:3.0:1788625654.265415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046ad9382 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845692160:12345-0@lo:400: Request processed in 61us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625654.265423:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788625654.265611:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003dd8ba74 x1875509845692160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625654.265627:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003dd8ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845692160:0@lo:400: 00000020:00000080:3.0:1788625654.885226:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd0cfff70 20000000:00000080:3.0:1788625654.885251:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b437958ec00 uarg=0000000000000000 20000000:01000000:3.0:1788625654.885300:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788625654.885310:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788625654.885316:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788625654.885665:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788625654.885679:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788625654.897294:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625654.897653:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788625654.897766:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788625654.897838:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788625654.897869:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625654.897894:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.897919:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.897929:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.897986:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.898006:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625654.898035:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1875509845692288:0@lo:104: 00000100:00100000:0.0:1788625654.898137:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625654.898219:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e2d077b going to sleep for 11 seconds 00000100:00100000:2.0:1788625654.898400:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692288 00000100:00100000:2.0:1788625654.898412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692288 00000100:00100000:2.0:1788625654.898476:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625654.898487:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a13e064 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:6321:x1875509845692288:12345-0@lo:104: 00010000:00010000:2.0:1788625654.898502:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625654.898567:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625654.898573:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a13e064 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:6321:x1875509845692288:12345-0@lo:104: Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625654.898580:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788625654.899845:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625654.899858:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.899872:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f67a55c already unused, calling callback (0000000082f673db) 10000000:00010000:3.0:1788625654.899876:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.899885:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625654.899893:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625654.899912:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625654.899966:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.899973:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625654.899996:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900004:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000007f67a55c/0x8aede7274cb13463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1346a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900041:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625654.900043:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625654.900045:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625654.900082:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a36e3292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845692416:0@lo:103: 00000100:00100000:3.0:1788625654.900147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625654.900219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692416 00000100:00100000:3.0:1788625654.900227:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692416 00010000:00010000:3.0:1788625654.900259:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 12 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625654.900290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625654.900298:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffbf019c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3309:x1875509845692416:12345-0@lo:103: 00010000:00010000:3.0:1788625654.900313:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625654.900319:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 12 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900331:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 12 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900359:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900367:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900385:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900392:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900400:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900406:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900412:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079cb8018 already unused, calling callback (00000000b24f944b) 00010000:00010000:3.0:1788625654.900416:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900424:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900433:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625654.900443:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625654.900477:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffbf019c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3309:x1875509845692416:12345-0@lo:103: Request processed in 179us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625654.900496:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625654.900550:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a36e3292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845692416:0@lo:103: 00010000:00010000:0.0:1788625654.900852:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009bb219be/0x8aede7274cb1346a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13463 expref: 11 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625654.900867:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1875509845692288:0@lo:104: 00010000:00010000:0.0:1788625654.900884:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.900893:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.900907:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625654.900913:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079cb8018/0x8aede7274cb134a9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625655.026841:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625656.051697:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788625656.627325:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625656.627333:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346652800 from 1 10000000:01000000:2.0:1788625656.627338:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625656.627404:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000002b308970/0x8aede7274cb134b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625656.627416:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000002b308970/0x8aede7274cb134b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625656.627444:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000002b308970/0x8aede7274cb134b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625656.627466:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692544:0@lo:101: 00000100:00100000:2.0:1788625656.627540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625656.627628:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e15b0990 going to sleep for 11 seconds 00000100:00100000:1.0:1788625656.627776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692544 00000100:00100000:1.0:1788625656.627785:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692544 00000100:00100000:1.0:1788625656.627839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625656.627847:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019dd8bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:5838:x1875509845692544:12345-0@lo:101: 00010000:00010000:1.0:1788625656.627860:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625656.627872:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038646080/0x8aede7274cb134b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb134b0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625656.627895:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038646080/0x8aede7274cb134b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625656.627906:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038646080/0x8aede7274cb134b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625656.627927:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038646080, rc 0) 00000100:00100000:1.0:1788625656.627984:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019dd8bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845692544:12345-0@lo:101: Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625656.628010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625656.630322:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000245c8b36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692544:0@lo:101: 00010000:00010000:0.0:1788625656.630350:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000002b308970/0x8aede7274cb134b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625656.630362:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000002b308970/0x8aede7274cb134b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625656.630452:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692672:0@lo:501: 00000100:00100000:0.0:1788625656.630508:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625656.630553:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c05c9d46 going to sleep for 11 seconds 00000100:00100000:1.0:1788625656.630896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692672 00000100:00100000:1.0:1788625656.630904:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692672 00000100:00100000:1.0:1788625656.630961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625656.630968:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e8a591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845692672:12345-0@lo:501: 00000100:00100000:1.0:1788625656.631256:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e8a591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845692672:12345-0@lo:501: Request processed in 288us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625656.631264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625656.631812:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692672:0@lo:501: 00000100:00100000:0.0:1788625656.631857:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692800:0@lo:503: 00000100:00100000:0.0:1788625656.631906:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625656.631949:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c05c9d46 going to sleep for 11 seconds 00000100:00100000:2.0:1788625656.632114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692800 00000100:00100000:2.0:1788625656.632120:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692800 00000100:00100000:2.0:1788625656.632162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625656.632170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2eda70f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845692800:12345-0@lo:503: 00000100:00100000:2.0:1788625656.632327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2eda70f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845692800:12345-0@lo:503: Request processed in 158us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625656.632333:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625656.632607:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5f65790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845692800:0@lo:503: 00000100:00100000:2.0:1788625656.633011:0:6382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fd1f4cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6382:1875509845692928:0@lo:502: 00000100:00100000:2.0:1788625656.633051:0:6382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625656.633084:0:6382:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eff7475b going to sleep for 11 seconds 00000100:00100000:3.0:1788625656.633192:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845692928 00000100:00100000:3.0:1788625656.633198:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845692928 00000100:00100000:3.0:1788625656.633231:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625656.633238:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dcad5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6382:x1875509845692928:12345-0@lo:502: 00000100:00100000:3.0:1788625656.633388:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dcad5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6382:x1875509845692928:12345-0@lo:502: Request processed in 151us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625656.633395:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625656.633708:0:6382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fd1f4cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6382:1875509845692928:0@lo:502: 00000020:01000000:0.0:1788625656.633777:0:6382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625656.633787:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625656.633795:0:6382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625656.633803:0:6382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4346652800 00000020:00000080:0.0:1788625656.633806:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625656.633846:0:6382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6382:1875509845693056:0@lo:502: 00000100:00100000:0.0:1788625656.633884:0:6382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625656.633903:0:6382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434385b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625656.633963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693056 00000100:00100000:3.0:1788625656.633967:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693056 00000100:00100000:3.0:1788625656.634006:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625656.634013:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6382:x1875509845693056:12345-0@lo:502: 00000100:00100000:3.0:1788625656.634130:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6382:x1875509845693056:12345-0@lo:502: Request processed in 117us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625656.634137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625656.634262:0:6382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6382:1875509845693056:0@lo:502: 00000020:01000000:0.0:1788625656.634279:0:6382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625656.634284:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625656.634286:0:6382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788625656.634289:0:6382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788625656.634631:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788625656.634651:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625656.634660:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625656.634672:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625657.076151:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625658.109694:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625659.129157:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625659.380010:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845693184:0@lo:400: 00000100:00100000:2.0:1788625659.380081:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625659.380143:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625659.380150:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845693312:0@lo:400: 00000100:00100000:2.0:1788625659.380178:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625659.380214:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693184 00000100:00100000:2.0:1788625659.380222:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693184 00000100:00100000:2.0:1788625659.380265:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625659.380273:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3310:x1875509845693184:12345-0@lo:400: 00000100:00100000:2.0:1788625659.380317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3310:x1875509845693184:12345-0@lo:400: Request processed in 44us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625659.380330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625659.380373:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693312 00000100:00100000:2.0:1788625659.380377:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693312 00000100:00100000:3.0:1788625659.383445:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845693184:0@lo:400: 00000100:00100000:3.0:1788625659.383518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625659.383533:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845693312:12345-0@lo:400: 00000100:00100000:3.0:1788625659.383617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845693312:12345-0@lo:400: Request processed in 90us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625659.383625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788625659.383667:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b434fcd1880 x1875509845693312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625659.383680:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845693312:0@lo:400: 00010000:00010000:1.0:1788625660.147003:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625661.171868:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788625661.687658:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625661.687662:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788625661.687825:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b4377f6e800 00000020:01000004:3.0:1788625661.687843:0:6694:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788625661.687858:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788625661.687872:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b43463919c0) 00000020:00000080:3.0:1788625661.687888:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788625661.721891:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788625661.722165:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788625661.750841:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788625661.757201:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788625661.757239:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788625661.757305:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788625661.757331:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788625661.757864:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788625661.757876:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788625661.757888:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8aede7274cb134c5 00000020:01000004:3.0:1788625661.757895:0:6694:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788625661.757929:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788625661.757933:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788625661.757944:0:6694:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788625661.757948:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788625661.757959:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b4346393380) 00000020:00000080:3.0:1788625661.757968:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788625661.759160:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625661.759336:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788625661.759343:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788625661.760314:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788625661.760322:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788625661.760926:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625661.760933:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788625661.762208:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625661.762372:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788625661.762378:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788625661.769879:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788625661.769897:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788625661.797165:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625661.797530:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625661.797538:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788625661.798690:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788625661.798700:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788625661.800082:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625661.800095:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788625661.801980:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625661.802200:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788625661.802207:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788625661.803433:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625661.803446:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788625661.850571:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625661.850963:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788625661.850972:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788625661.852171:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788625661.852182:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788625661.852691:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788625661.853174:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788625661.853182:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788625661.876565:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788625661.876596:0:6694:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788625661.876600:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788625661.876601:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625661.876602:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625661.876604:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625661.876605:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625661.876605:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625661.876606:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625661.876607:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625661.876608:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625661.876609:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625661.876610:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625661.876612:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788625661.876614:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788625661.876615:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625661.876615:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625661.876618:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625661.876619:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625661.876619:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625661.876620:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625661.876621:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625661.876621:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625661.876622:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625661.876622:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625661.876645:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788625661.876661:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845693440:0@lo:253: 00000100:00100000:1.0:1788625661.876724:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625661.876798:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693440 00000100:00100000:2.0:1788625661.876806:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693440 00000100:00100000:2.0:1788625661.876855:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625661.876864:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845693440:12345-0@lo:253: 00000100:00100000:1.0:1788625661.876887:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b3c0 going to sleep for 11 seconds 20000000:01000000:2.0:1788625661.876953:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788625661.876957:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788625661.876961:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788625661.876964:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788625661.877964:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625661.878172:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788625661.878182:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788625661.878207:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788625661.878212:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788625661.878226:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788625661.878251:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788625661.878521:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788625661.878535:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:2.0:1788625661.878536:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788625661.878556:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788625661.878560:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625661.878593:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788625661.878603:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:2.0:1788625661.878622:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788625661.878627:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788625661.878641:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788625661.878666:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788625661.879536:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788625661.879553:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1788625661.879554:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788625661.879574:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788625661.879578:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788625661.879593:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788625661.879597:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1788625661.879631:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788625661.879637:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788625661.879655:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788625661.879683:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788625661.879708:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788625661.879710:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788625661.879713:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788625661.879723:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788625661.879725:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788625661.879767:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788625661.879769:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625661.880138:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625661.880184:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625661.880232:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788625661.880413:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788625661.880440:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788625661.880461:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788625661.880472:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788625661.880474:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788625661.880877:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788625661.881032:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788625661.881061:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788625661.881095:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788625661.881107:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788625661.881109:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625661.881424:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625661.881465:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625661.881513:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788625661.881633:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788625661.881654:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788625661.881682:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788625661.881691:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788625661.881693:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788625661.881701:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788625661.881720:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881769:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881777:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13401 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881783:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13471 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881790:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881829:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881844:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 12 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625661.881856:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693568:0@lo:104: 00000100:00100000:3.0:1788625661.881925:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625661.881976:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.881985:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 12 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625661.881993:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693696:0@lo:104: 00000100:00100000:3.0:1788625661.882014:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625661.882041:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.882048:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 12 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625661.882055:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693824:0@lo:104: 00000100:00100000:3.0:1788625661.882073:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.882082:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351a03000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.882152:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693568 00000100:00100000:0.0:1788625661.882161:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693568 00000100:00100000:0.0:1788625661.882192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693696 00000100:00100000:0.0:1788625661.882195:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693696 00000100:00100000:0.0:1788625661.882205:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693824 00000100:00100000:0.0:1788625661.882207:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693824 00000100:00100000:0.0:1788625661.882221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625661.882230:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5835:x1875509845693568:12345-0@lo:104: 00010000:00010000:0.0:1788625661.882243:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.882294:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625661.882309:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5835:x1875509845693568:12345-0@lo:104: Request processed in 73us (376us total) trans 0 rc 0/0 00010000:00010000:1.0:1788625661.882317:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788625661.882317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788625661.882323:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882330:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340030e00 already unused, calling callback (ffffffffc1c72c20) 00000100:00100000:0.0:1788625661.882333:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 10000000:00010000:1.0:1788625661.882334:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.882338:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5835:x1875509845693696:12345-0@lo:104: 00010000:00010000:1.0:1788625661.882342:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.882345:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625661.882351:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625661.882368:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625661.882377:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625661.882381:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5835:x1875509845693696:12345-0@lo:104: Request processed in 44us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.882386:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788625661.882395:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.882398:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788625661.882402:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788625661.882403:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5835:x1875509845693824:12345-0@lo:104: 00010000:00010000:0.0:1788625661.882409:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882414:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882423:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13478 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882437:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625661.882440:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.882440:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625661.882445:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5835:x1875509845693824:12345-0@lo:104: Request processed in 42us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1788625661.882446:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625661.882449:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.882451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788625661.882456:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625661.882462:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625661.882467:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625661.882478:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625661.882479:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882484:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625661.882496:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882502:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb13401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.882512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625661.882513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625661.882515:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625661.882983:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845693952:0@lo:103: 00000100:00100000:3.0:1788625661.883009:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.883067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625661.883072:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845694080:0@lo:103: 00000100:00100000:3.0:1788625661.883085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625661.883224:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625661.883226:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625661.883227:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625661.883271:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883276:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3600 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625661.883278:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883284:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625661.883288:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625661.883291:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625661.883325:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883332:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625661.883351:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.883355:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845694208:0@lo:103: 00010000:00010000:0.0:1788625661.883358:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb133e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb133ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883385:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625661.883387:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625661.883389:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625661.883501:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.883528:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693568:0@lo:104: 00000100:00100000:3.0:1788625661.883537:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693696:0@lo:104: 00000100:00100000:3.0:1788625661.883546:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875509845693824:0@lo:104: 00010000:00010000:3.0:1788625661.883566:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625661.883657:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845693952 00000100:00100000:2.0:1788625661.883663:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845693952 00010000:00010000:2.0:1788625661.883685:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 13 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.883721:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694080 00000100:00100000:0.0:1788625661.883725:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694080 00010000:00010000:0.0:1788625661.883761:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 14 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.883775:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694208 00000100:00100000:0.0:1788625661.883778:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694208 00010000:00010000:0.0:1788625661.883788:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 15 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.883800:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625661.883807:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3308:x1875509845693952:12345-0@lo:103: 00010000:00010000:0.0:1788625661.883817:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625661.883823:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 15 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883834:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 15 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883848:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3800/0x8aede7274cb13478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13471 expref: 15 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883861:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625661.883901:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3308:x1875509845693952:12345-0@lo:103: Request processed in 94us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.883918:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625661.883930:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845693952:0@lo:103: 00000100:00100000:0.0:1788625661.883941:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625661.883947:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3308:x1875509845694080:12345-0@lo:103: 00010000:00010000:0.0:1788625661.883954:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625661.883959:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 13 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883968:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 13 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883978:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016c00/0x8aede7274cb13408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13401 expref: 13 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.883987:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625661.884015:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3308:x1875509845694080:12345-0@lo:103: Request processed in 68us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.884021:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625661.884033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845694080:0@lo:103: 00000100:00100000:0.0:1788625661.884033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625661.884039:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:3310:x1875509845694208:12345-0@lo:103: 00010000:00010000:0.0:1788625661.884046:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625661.884050:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 11 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884059:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 11 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884069:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7400/0x8aede7274cb133ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb133e5 expref: 11 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884080:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884101:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884115:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884123:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884129:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884135:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884139:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625661.884143:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884151:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884169:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.884177:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625661.884208:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.884208:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:3310:x1875509845694208:12345-0@lo:103: Request processed in 167us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.884214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788625661.884216:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.884222:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f6800/0x8aede7274cb134d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625661.884235:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788625661.884237:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845694208:0@lo:103: 00000100:00100000:3.0:1788625661.905058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:6694:x1875509845693440:12345-0@lo:253: Request processed in 28185us (28323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625661.905073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788625661.905083:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845693440:0@lo:253: 10000000:01000000:1.0:1788625661.905110:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788625661.905114:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625661.905130:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625661.905131:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625661.905132:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788625661.905134:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625661.905135:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625661.905137:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625661.905138:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788625661.905140:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625661.905142:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788625661.905162:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b4377f6e800 from lustre-OST0000 10000000:01000000:1.0:1788625661.905186:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788625661.905189:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788625661.905196:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b4346390000 local copy 10000000:01000000:1.0:1788625661.905200:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788625661.905234:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.905244:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.905254:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.905270:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694336:0@lo:101: 00000100:00100000:1.0:1788625661.905301:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.905546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694336 00000100:00100000:3.0:1788625661.905553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694336 00000100:00100000:1.0:1788625661.905586:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625661.905631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625661.905641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:6694:x1875509845694336:12345-0@lo:101: 00010000:00010000:3.0:1788625661.905654:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625661.905671:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f6600/0x8aede7274cb134e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb134da expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.905697:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6600/0x8aede7274cb134e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb134da expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.905799:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f6600/0x8aede7274cb134e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134da expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.905809:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625661.905852:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:6694:x1875509845694336:12345-0@lo:101: Request processed in 213us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625661.905858:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788625661.905975:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694336:0@lo:101: 00010000:00010000:1.0:1788625661.905987:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.905996:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.906110:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694464:0@lo:501: 00000100:00100000:1.0:1788625661.906136:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.906380:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625661.906520:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694464 00000100:00100000:2.0:1788625661.906527:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694464 00000100:00100000:3.0:1788625661.906574:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625661.906582:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:6694:x1875509845694464:12345-0@lo:501: 00000100:00100000:3.0:1788625661.906913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:6694:x1875509845694464:12345-0@lo:501: Request processed in 321us (765us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625661.906922:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788625661.906949:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694464:0@lo:501: 10000000:01000000:1.0:1788625661.906961:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788625661.906988:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788625661.906994:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907003:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907010:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907034:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625661.907055:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788625661.907059:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b4377f6e800 10000000:01000000:1.0:1788625661.907064:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625661.907067:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625661.907067:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b4346390000 10000000:01000000:1.0:1788625661.907069:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788625661.907073:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b4346390000 from 1 00010000:00010000:3.0:1788625661.907074:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3c00 already unused, calling callback (ffffffffc1c72c20) 10000000:01000000:1.0:1788625661.907075:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:3.0:1788625661.907078:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.907086:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625661.907093:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907095:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625661.907099:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625661.907103:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.907116:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907119:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.907122:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788625661.907131:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694592:0@lo:101: 00010000:00010000:3.0:1788625661.907140:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.907147:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3c00/0x8aede7274cb134da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb134e1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.907156:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625661.907162:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625661.907164:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625661.907210:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625661.907222:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845694720:0@lo:103: 00000100:00100000:3.0:1788625661.907248:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.907302:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625661.907329:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694720 00000100:00100000:3.0:1788625661.907334:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694720 00000100:00100000:3.0:1788625661.907371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625661.907378:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:3311:x1875509845694720:12345-0@lo:103: 00010000:00010000:3.0:1788625661.907389:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625661.907400:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f6600/0x8aede7274cb134e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb134da expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.907415:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625661.907461:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:3311:x1875509845694720:12345-0@lo:103: Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625661.907468:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625661.907525:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845694720:0@lo:103: 00000100:00100000:2.0:1788625661.907639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694592 00000100:00100000:2.0:1788625661.907643:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694592 00000100:00100000:0.0:1788625661.907672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625661.907679:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+9:6694:x1875509845694592:12345-0@lo:101: 00010000:00010000:0.0:1788625661.907686:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625661.907694:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031e00/0x8aede7274cb134ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb134e8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.907722:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031e00/0x8aede7274cb134ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb134e8 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.907749:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031e00/0x8aede7274cb134ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134e8 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.907756:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031e00, rc 0) 00000100:00100000:0.0:1788625661.907793:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:6694:x1875509845694592:12345-0@lo:101: Request processed in 114us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.907798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625661.907951:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694592:0@lo:101: 00010000:00010000:1.0:1788625661.907961:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907967:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625661.907977:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788625661.907989:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.907994:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625661.907998:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788625661.908001:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625661.908004:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788625661.908005:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625661.908023:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.908037:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.908042:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.908050:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694848:0@lo:101: 00000100:00100000:1.0:1788625661.908069:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.908081:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.908127:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694848 00000100:00100000:0.0:1788625661.908130:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694848 00000100:00100000:0.0:1788625661.908154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625661.908158:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+10:6694:x1875509845694848:12345-0@lo:101: 00010000:00010000:0.0:1788625661.908162:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625661.908168:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb134f6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.908177:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.908182:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.908193:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340030600, rc 0) 00000100:00100000:0.0:1788625661.908212:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845694848:12345-0@lo:101: Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.908216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625661.908269:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694848:0@lo:101: 00010000:00010000:1.0:1788625661.908276:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625661.908281:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625661.908339:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694976:0@lo:501: 00000100:00100000:1.0:1788625661.908356:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.908370:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.908467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845694976 00000100:00100000:0.0:1788625661.908470:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845694976 00000100:00100000:0.0:1788625661.908491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625661.908495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845694976:12345-0@lo:501: 00000100:00100000:0.0:1788625661.908634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845694976:12345-0@lo:501: Request processed in 138us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.908638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625661.908808:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845694976:0@lo:501: 00000100:00100000:1.0:1788625661.908830:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695104:0@lo:503: 00000100:00100000:1.0:1788625661.908857:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.908878:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.909214:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695104 00000100:00100000:0.0:1788625661.909218:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695104 00000100:00100000:0.0:1788625661.909242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625661.909246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695104:12345-0@lo:503: 00000100:00100000:1.0:1788625661.909527:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695104:0@lo:503: 00000040:00080000:1.0:1788625661.909877:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625661.909942:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695232:0@lo:502: 00000100:00100000:1.0:1788625661.909971:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.910014:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.910054:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695104:12345-0@lo:503: Request processed in 206us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.910060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625661.910083:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695232 00000100:00100000:0.0:1788625661.910086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695232 00000100:00100000:0.0:1788625661.910098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625661.910102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695232:12345-0@lo:502: 00000100:00100000:0.0:1788625661.910198:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695232:12345-0@lo:502: Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.910202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625661.910262:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695232:0@lo:502: 00000040:00080000:1.0:1788625661.910429:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788625661.910483:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788625661.910504:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788625661.910539:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788625661.910563:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788625661.910580:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788625661.910595:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695360:0@lo:502: 00000100:00100000:1.0:1788625661.910618:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625661.910640:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.910834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695360 00000100:00100000:0.0:1788625661.910842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695360 00000100:00100000:0.0:1788625661.910857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625661.910860:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695360:12345-0@lo:502: 00000100:00100000:0.0:1788625661.910969:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695360:12345-0@lo:502: Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.910974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625661.911115:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695360:0@lo:502: 00000040:00080000:1.0:1788625661.911169:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788625661.911176:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788625661.911863:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625661.911872:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788625661.911877:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625661.911879:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788625661.911885:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625661.911899:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b43795f4d40) 00000020:00000080:1.0:1788625661.911929:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788625661.911935:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625661.912004:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b4377f6e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788625661.912011:0:6713:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625661.912018:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8aede7274cb1350b 00010000:00010000:1.0:1788625661.916953:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788625661.917275:0:6713:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788625661.922662:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788625661.923132:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788625661.936197:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788625661.938655:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788625661.941834:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788625661.941844:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625661.941850:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625661.941851:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788625661.941854:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625661.941857:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625661.941858:0:6713:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625661.941859:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625661.941861:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625661.941918:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625661.941922:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625661.941923:0:6713:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625661.941926:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788625661.942002:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788625661.942025:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788625661.942040:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.942057:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625661.942066:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4377f6e800 from 1 10000000:01000000:0.0:1788625661.942069:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625661.942105:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.942114:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.942126:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.942150:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695488:0@lo:101: 00000100:00100000:0.0:1788625661.942224:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625661.942274:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344d9e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625661.942658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695488 00000100:00100000:2.0:1788625661.942666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695488 00000100:00100000:2.0:1788625661.943199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625661.943210:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:6694:x1875509845695488:12345-0@lo:101: 00010000:00010000:2.0:1788625661.943225:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625661.943247:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13512 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625661.943274:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13512 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625661.943286:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13512 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625661.943296:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016800, rc 0) 00000100:00100000:2.0:1788625661.943420:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695488:12345-0@lo:101: Request processed in 212us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625661.943428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625661.943567:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695488:0@lo:101: 00010000:00010000:0.0:1788625661.943592:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.943602:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625661.945830:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695616:0@lo:501: 00000100:00100000:0.0:1788625661.945888:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625661.945940:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344d9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625661.945942:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695616 00000100:00100000:1.0:1788625661.945950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695616 00000100:00100000:1.0:1788625661.945992:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788625661.946001:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695616:12345-0@lo:501: 00000100:00100000:1.0:1788625661.946275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695616:12345-0@lo:501: Request processed in 274us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625661.946300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625661.946399:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695616:0@lo:501: 00000100:00100000:2.0:1788625661.946438:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695744:0@lo:503: 00000100:00100000:2.0:1788625661.946565:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625661.946582:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.946825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695744 00000100:00100000:0.0:1788625661.946830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695744 00000100:00100000:0.0:1788625661.946859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625661.946867:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695744:12345-0@lo:503: 00000100:00100000:0.0:1788625661.947123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695744:12345-0@lo:503: Request processed in 256us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.947134:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625661.947372:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695744:0@lo:503: 00000040:00080000:2.0:1788625661.953517:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625661.953624:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695872:0@lo:502: 00000100:00100000:2.0:1788625661.953725:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625661.953785:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.954931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845695872 00000100:00100000:0.0:1788625661.954944:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845695872 00000100:00100000:0.0:1788625661.954989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625661.954999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695872:12345-0@lo:502: 00000100:00100000:0.0:1788625661.958379:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845695872:12345-0@lo:502: Request processed in 3370us (4642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.958395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625661.967661:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845695872:0@lo:502: 00000040:00080000:3.0:1788625661.972505:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788625661.972628:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788625661.972685:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696000:0@lo:502: 00000100:00100000:3.0:1788625661.972815:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625661.972858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696000 00000100:00100000:3.0:1788625661.972863:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43435b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.972866:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696000 00000100:00100000:0.0:1788625661.972922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625661.972933:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845696000:12345-0@lo:502: 00000100:00100000:0.0:1788625661.973148:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845696000:12345-0@lo:502: Request processed in 215us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.973157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625661.975620:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696000:0@lo:502: 00000040:00080000:3.0:1788625661.977055:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788625661.977076:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788625661.979251:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625661.979264:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625661.979267:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788625661.979274:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4377f6e800 00000020:00000080:1.0:1788625661.979276:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625661.979294:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625661.979297:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625661.979298:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788625661.979301:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788625661.979382:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788625661.979417:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625661.979438:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.979460:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625661.979500:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788625661.979514:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b4377f6e800 10000000:01000000:3.0:1788625661.979516:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b4377f6e800 10000000:01000000:3.0:1788625661.979520:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625661.979526:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4377f6e800 from 1 10000000:01000000:3.0:1788625661.979529:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625661.979564:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.979574:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.979584:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625661.979605:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696128:0@lo:101: 00000100:00100000:3.0:1788625661.979670:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625661.979773:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696128 00000100:00100000:0.0:1788625661.979784:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696128 00000100:00100000:0.0:1788625661.979830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625661.979841:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845696128:12345-0@lo:101: 00010000:00010000:0.0:1788625661.979855:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625661.979869:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13520 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.979896:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13520 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.979919:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13520 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625661.979928:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031000, rc 0) 00000100:00100000:0.0:1788625661.979962:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696128:12345-0@lo:101: Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.979969:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625661.980091:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43435b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625661.980115:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696128:0@lo:101: 00010000:00010000:3.0:1788625661.980129:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625661.980139:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625661.980419:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696256:0@lo:501: 00000100:00100000:3.0:1788625661.980558:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.980586:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43435b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625661.980813:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696256 00000100:00100000:1.0:1788625661.980820:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696256 00000100:00100000:2.0:1788625661.980919:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625661.980931:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696256:12345-0@lo:501: 00000100:00100000:2.0:1788625661.981175:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696256:12345-0@lo:501: Request processed in 240us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625661.981182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625661.981396:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696256:0@lo:501: 00000100:00100000:3.0:1788625661.981555:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696384:0@lo:503: 00000100:00100000:3.0:1788625661.981601:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.981635:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43435b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625661.981872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696384 00000100:00100000:1.0:1788625661.981879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696384 00000100:00100000:1.0:1788625661.981955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625661.981964:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696384:12345-0@lo:503: 00000100:00100000:1.0:1788625661.982120:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696384:12345-0@lo:503: Request processed in 157us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625661.982127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625661.982259:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696384:0@lo:503: 00000040:00080000:3.0:1788625661.984022:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625661.984115:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696512:0@lo:502: 00000100:00100000:3.0:1788625661.984286:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625661.985918:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43455329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.988186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696512 00000100:00100000:0.0:1788625661.988204:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696512 00000100:00100000:0.0:1788625661.988268:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625661.988279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696512:12345-0@lo:502: 00000100:00100000:0.0:1788625661.988825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696512:12345-0@lo:502: Request processed in 547us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.988834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625661.992341:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696512:0@lo:502: 00000040:00080000:2.0:1788625661.997002:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788625661.997071:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788625661.997120:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788625661.997162:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788625661.997197:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788625661.997246:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788625661.997284:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788625661.997320:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788625661.997374:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788625661.997426:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788625661.997464:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788625661.997528:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788625661.997586:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788625661.997622:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788625661.997687:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788625661.997770:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788625661.997809:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788625661.997859:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788625661.997895:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788625661.997941:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788625661.997990:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788625661.998024:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788625661.998052:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788625661.998093:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788625661.998137:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788625661.998167:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788625661.998214:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788625661.998248:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788625661.998298:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696640:0@lo:502: 00000100:00100000:2.0:1788625661.998376:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625661.998423:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625661.998560:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696640 00000100:00100000:0.0:1788625661.998567:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696640 00000100:00100000:0.0:1788625661.998616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625661.998626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696640:12345-0@lo:502: 00000100:00100000:0.0:1788625661.998852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845696640:12345-0@lo:502: Request processed in 226us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625661.998859:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788625662.004599:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845696640:0@lo:502: 00000040:00080000:2.0:1788625662.005268:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788625662.005289:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788625662.009157:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788625662.009173:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b434fce19c0) 00000020:00000080:0.0:1788625662.009195:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788625662.009283:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b4377f6e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788625662.009287:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b4377f6e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788625662.009290:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4377f6e800 3 00010000:00080000:0.0:1788625662.009318:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b437fca3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1788625662.012958:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788625662.020152:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788625662.020194:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625662.020209:0:6718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8aede7274cb13535 00000100:00080000:0.0:1788625662.020220:0:6718:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625662.020227:0:6718:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b437fca3800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625662.020265:0:6718:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b436ea08380 x1875509845696768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625662.020330:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845696768:0@lo:38: 00000100:00100000:3.0:1788625662.020400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625662.020501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696768 00000100:00100000:1.0:1788625662.020510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696768 00000100:00100000:1.0:1788625662.020561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625662.020569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875509845696768:12345-0@lo:38: 00010000:00080000:1.0:1788625662.020593:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1788625662.021285:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8aede7274cb1353c 00000004:00100000:1.0:1788625662.021302:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788625662.021337:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9b437fc54800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788625662.022078:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788625662.022479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845696896:0@lo:400: 00000100:00100000:0.0:1788625662.022535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625662.022581:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625662.022588:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845697024:0@lo:400: 00000100:00100000:0.0:1788625662.022613:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625662.022692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845696896 00000100:00100000:2.0:1788625662.022699:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845696896 00000100:00100000:2.0:1788625662.022785:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625662.022795:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3308:x1875509845696896:12345-0@lo:400: 00000100:00100000:2.0:1788625662.022845:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3308:x1875509845696896:12345-0@lo:400: Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625662.022852:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625662.022885:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625662.022892:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788625662.022932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845696896:0@lo:400: 00000100:00100000:1.0:1788625662.023438:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875509845696768:12345-0@lo:38: Request processed in 2866us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625662.023445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625662.023581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697024 00000100:00100000:0.0:1788625662.023587:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697024 00010000:00080000:3.0:1788625662.030063:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b436ea08380 x1875509845696768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625662.030081:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625662.030103:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788625662.030113:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788625662.030119:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625662.030123:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b437fca3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625662.030131:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845696768:0@lo:38: 00000100:00100000:0.0:1788625662.030541:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625662.030564:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845697024:12345-0@lo:400: 00000100:00100000:0.0:1788625662.030661:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845697024:12345-0@lo:400: Request processed in 110us (8046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625662.030669:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788625662.030922:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1788625662.032879:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b434fcd0700 x1875509845697024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625662.032895:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845697024:0@lo:400: 00000020:01000000:2.0:1788625662.032959:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788625662.032992:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625662.033015:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.033025:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625662.033070:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625662.033072:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788625662.033073:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625662.033074:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625662.033075:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625662.033079:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625662.033081:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625662.033082:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625662.033083:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625662.033085:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625662.033086:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625662.033090:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788625662.033092:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625662.033093:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788625662.033094:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625662.033095:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625662.033096:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625662.033097:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625662.033097:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625662.033098:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625662.033099:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625662.033100:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625662.033101:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625662.033124:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788625662.033138:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845697152:0@lo:253: 00000100:00100000:2.0:1788625662.033204:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625662.033246:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625662.036361:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697152 00000100:00100000:2.0:1788625662.036377:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697152 00000100:00100000:2.0:1788625662.036448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625662.036459:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6694:x1875509845697152:12345-0@lo:253: 20000000:01000000:2.0:1788625662.036514:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625662.036530:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788625662.096352:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788625662.096401:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788625662.103000:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625662.103011:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625662.103034:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.103053:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1349b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.103061:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.103402:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.103418:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 13 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625662.103433:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845697280:0@lo:104: 00000100:00100000:0.0:1788625662.103497:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625662.103570:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4352b0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625662.105200:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697280 00000100:00100000:2.0:1788625662.105213:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697280 00000100:00100000:2.0:1788625662.105292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625662.105303:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845697280:12345-0@lo:104: 00010000:00010000:2.0:1788625662.105320:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105422:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625662.105429:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845697280:12345-0@lo:104: Request processed in 128us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625662.105436:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788625662.105459:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625662.105465:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105472:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2600 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625662.105477:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105485:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625662.105492:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625662.105498:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625662.105529:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105535:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625662.105550:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105558:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d2600/0x8aede7274cb1349b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.105589:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625662.105591:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625662.105592:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625662.105601:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625662.105615:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845697408:0@lo:103: 00000100:00100000:2.0:1788625662.105654:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625662.105694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697408 00000100:00100000:2.0:1788625662.105699:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697408 00010000:00010000:2.0:1788625662.105717:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625662.105971:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845697280:0@lo:104: 00010000:00010000:0.0:1788625662.105992:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625662.106152:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625662.106161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3311:x1875509845697408:12345-0@lo:103: 00010000:00010000:2.0:1788625662.106175:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625662.106180:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106190:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106203:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb134a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1349b expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106217:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106225:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625662.106346:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003335897s 00010000:00010000:2.0:1788625662.106351:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106359:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106366:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106373:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106378:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340031400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625662.106382:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106390:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106404:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625662.106413:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625662.106448:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3311:x1875509845697408:12345-0@lo:103: Request processed in 289us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625662.106455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625662.106521:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845697408:0@lo:103: 00010000:00010000:0.0:1788625662.106582:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.106590:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625662.106596:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031400/0x8aede7274cb13543 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625662.122617:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:6694:x1875509845697152:12345-0@lo:253: Request processed in 86151us (89402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625662.122644:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625662.122923:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6694:1875509845697152:0@lo:253: 10000000:01000000:0.0:1788625662.122940:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788625662.122943:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625662.122944:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625662.122946:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625662.122947:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625662.122949:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625662.122950:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625662.122952:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625662.122953:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625662.122954:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625662.122956:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625662.122957:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625662.122971:0:6694:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788625662.131970:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625662.132163:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625662.132521:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625662.132924:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788625662.133125:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788625662.134455:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788625662.137126:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788625662.200037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788625662.426039:0:6694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788625662.426046:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788625662.426078:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788625662.426139:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788625662.426154:0:6694:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788625662.426182:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788625663.220208:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625664.242898:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788625665.204482:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625665.204491:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4346652800 from 21 10000000:01000000:0.0:1788625665.204496:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625665.204540:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625665.204552:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625665.204563:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625665.204587:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697536:0@lo:101: 00000100:00100000:0.0:1788625665.204652:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.204704:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.205068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697536 00000100:00100000:3.0:1788625665.205076:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697536 00000100:00100000:3.0:1788625665.205129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625665.205139:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845697536:12345-0@lo:101: 00010000:00010000:3.0:1788625665.205154:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625665.205176:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1354a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.205201:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1354a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.205212:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1354a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.205223:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7e00, rc 0) 00000100:00100000:3.0:1788625665.205276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845697536:12345-0@lo:101: Request processed in 139us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.205284:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625665.205453:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697536:0@lo:101: 00010000:00010000:0.0:1788625665.205468:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625665.205478:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625665.205531:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697664:0@lo:501: 00000100:00100000:0.0:1788625665.205557:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.205593:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625665.205631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697664 00000100:00100000:2.0:1788625665.205645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697664 00000100:00100000:2.0:1788625665.205677:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625665.205685:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845697664:12345-0@lo:501: 00000100:00100000:2.0:1788625665.206060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845697664:12345-0@lo:501: Request processed in 363us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625665.206068:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625665.206233:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697664:0@lo:501: 00000100:00100000:0.0:1788625665.206259:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697792:0@lo:503: 00000100:00100000:0.0:1788625665.206296:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.206321:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.206523:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697792 00000100:00100000:3.0:1788625665.206528:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697792 00000100:00100000:3.0:1788625665.206559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788625665.206566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845697792:12345-0@lo:503: 00000100:00100000:3.0:1788625665.206876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845697792:12345-0@lo:503: Request processed in 308us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.206887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788625665.206927:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845697792:0@lo:503: 00000100:00100000:2.0:1788625665.215875:0:6874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6874:1875509845697920:0@lo:502: 00000100:00100000:2.0:1788625665.215967:0:6874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625665.216006:0:6874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4380771c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.217908:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845697920 00000100:00100000:3.0:1788625665.217922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845697920 00000100:00100000:3.0:1788625665.217993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788625665.218004:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6874:x1875509845697920:12345-0@lo:502: 00000100:00100000:3.0:1788625665.218386:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6874:x1875509845697920:12345-0@lo:502: Request processed in 383us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.218407:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788625665.219328:0:6874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6874:1875509845697920:0@lo:502: 00000100:00100000:2.0:1788625665.219427:0:6874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6874:1875509845698048:0@lo:502: 00000100:00100000:2.0:1788625665.219480:0:6874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625665.219527:0:6874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435058b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625665.220675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698048 00000100:00100000:1.0:1788625665.220685:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698048 00000100:00100000:1.0:1788625665.220751:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788625665.220762:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6874:x1875509845698048:12345-0@lo:502: 00000100:00100000:1.0:1788625665.221071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:6874:x1875509845698048:12345-0@lo:502: Request processed in 307us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625665.221081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625665.221201:0:6874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6874:1875509845698048:0@lo:502: 00000040:00080000:2.0:1788625665.221244:0:6874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788625665.222914:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788625665.222949:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625665.222965:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625665.222981:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625665.222995:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788625665.222998:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b4346652800 from 4 10000000:01000000:1.0:1788625665.223001:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788625665.223048:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625665.223076:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625665.223090:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625665.223111:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698176:0@lo:101: 00000100:00100000:1.0:1788625665.223174:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.223228:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434385b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625665.223981:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698176 00000100:00100000:2.0:1788625665.223991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698176 00000100:00100000:2.0:1788625665.224039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625665.224058:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845698176:12345-0@lo:101: 00010000:00010000:2.0:1788625665.224078:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625665.224095:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13558 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625665.224134:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625665.224144:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625665.224160:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017e00, rc 0) 00000100:00100000:2.0:1788625665.224222:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845698176:12345-0@lo:101: Request processed in 176us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625665.224232:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625665.225632:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698176:0@lo:101: 00010000:00010000:1.0:1788625665.225664:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625665.225676:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625665.225775:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698304:0@lo:256: 00000100:00100000:1.0:1788625665.225842:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.225892:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434385b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.227257:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698304 00000100:00100000:3.0:1788625665.227272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698304 00000100:00100000:3.0:1788625665.227333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625665.227352:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845698304:12345-0@lo:256: 20000000:01000000:3.0:1788625665.227383:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788625665.227412:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788625665.227418:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788625665.227536:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845698304:12345-0@lo:256: Request processed in 186us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.227547:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625665.227621:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698304:0@lo:256: 10000000:01000000:3.0:1788625665.227682:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625665.227690:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.227700:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625665.227710:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788625665.227713:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788625665.227716:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625665.227777:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.227789:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.227801:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625665.227841:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698432:0@lo:101: 00000100:00100000:3.0:1788625665.227887:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.227926:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.227942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698432 00000100:00100000:3.0:1788625665.227946:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698432 00000100:00100000:3.0:1788625665.227977:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625665.227983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845698432:12345-0@lo:101: 00010000:00010000:3.0:1788625665.227991:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625665.228003:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13566 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.228022:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13566 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.228032:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13566 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.228041:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625665.228209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845698432:12345-0@lo:101: Request processed in 225us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.228219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625665.228262:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698432:0@lo:101: 00010000:00010000:3.0:1788625665.228276:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.228291:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625665.228358:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698560:0@lo:501: 00000100:00100000:3.0:1788625665.228522:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625665.228676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698560 00000100:00100000:2.0:1788625665.228681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698560 00000100:00100000:2.0:1788625665.228708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625665.228715:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845698560:12345-0@lo:501: 00000100:00100000:2.0:1788625665.229030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845698560:12345-0@lo:501: Request processed in 315us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625665.229037:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788625665.230937:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.230976:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698560:0@lo:501: 00000100:00100000:3.0:1788625665.231031:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698688:0@lo:503: 00000100:00100000:3.0:1788625665.231100:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.231126:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.231152:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698688 00000100:00100000:3.0:1788625665.231158:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698688 00000100:00100000:3.0:1788625665.231192:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625665.231201:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845698688:12345-0@lo:503: 00000100:00100000:3.0:1788625665.231531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845698688:12345-0@lo:503: Request processed in 328us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.231538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625665.231585:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845698688:0@lo:503: 00000100:00100000:3.0:1788625665.231786:0:6876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6876:1875509845698816:0@lo:502: 00000100:00100000:3.0:1788625665.231822:0:6876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.231842:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698816 00000100:00100000:3.0:1788625665.231858:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698816 00000100:00100000:3.0:1788625665.231877:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625665.231884:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:6876:x1875509845698816:12345-0@lo:502: 00000100:00100000:3.0:1788625665.232063:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:6876:x1875509845698816:12345-0@lo:502: Request processed in 179us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.232071:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625665.232106:0:6876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.232119:0:6876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6876:1875509845698816:0@lo:502: 00000020:01000000:3.0:1788625665.232138:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788625665.232146:0:6876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788625665.232153:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625665.232155:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788625665.232159:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625665.232163:0:6876:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:3.0:1788625665.232184:0:6876:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788625665.232187:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625665.232201:0:6876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b4346394d40) 00000020:00000080:3.0:1788625665.232222:0:6876:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788625665.232228:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625665.232294:0:6876:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788625665.232300:0:6876:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788625665.232308:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb1357b 00010000:00080000:3.0:1788625665.232339:0:6876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b43795a2800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1788625665.232564:0:6876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1788625665.266872:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788625665.385764:0:6876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788625665.385789:0:6876:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788625665.386508:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625665.386864:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625665.386910:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788625665.386962:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788625665.388373:0:6883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625665.388381:0:6883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625665.389435:0:6876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625665.389448:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625665.389484:0:6876:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625665.389508:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb13582 00000100:00080000:2.0:1788625665.389521:0:6876:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625665.389538:0:6876:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b43795a2800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625665.389714:0:6876:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b434fcd1180 x1875509845698944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625665.389927:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845698944:0@lo:8: 00000100:00100000:3.0:1788625665.390001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.390102:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845698944 00000100:00100000:0.0:1788625665.390111:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845698944 00000100:00100000:0.0:1788625665.390150:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625665.390172:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875509845698944:12345-0@lo:8: 00010000:00080000:0.0:1788625665.390198:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1788625665.390224:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb13589 00002000:00100000:0.0:1788625665.390253:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b437fca3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788625665.390258:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788625665.390262:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788625665.390379:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788625665.390542:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788625665.390899:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b437fca7800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788625665.391030:0:6876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788625665.391145:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625665.391151:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625665.391286:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625665.391293:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625665.391299:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625665.391300:0:6876:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625665.391303:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625665.391305:0:6876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625665.391331:0:6876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6876:1875509845699072:0@lo:502: 00000100:00100000:2.0:1788625665.391380:0:6876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625665.391411:0:6876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344d9e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625665.391511:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875509845698944:12345-0@lo:8: Request processed in 1338us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625665.391520:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625665.391786:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845699328:0@lo:400: 00000100:00100000:1.0:1788625665.391825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.391888:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699328 00000100:00100000:1.0:1788625665.391894:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699328 00000100:00100000:1.0:1788625665.391952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625665.391960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845699328:12345-0@lo:400: 00000100:00100000:1.0:1788625665.392012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845699328:12345-0@lo:400: Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625665.392018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788625665.392035:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788625665.392062:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3fb80 x1875509845699328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.392075:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845699328:0@lo:400: 00000100:00100000:0.0:1788625665.392194:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625665.392204:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845699200:0@lo:400: 00000100:00100000:0.0:1788625665.392233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.392718:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699200 00000100:00100000:1.0:1788625665.392724:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699200 00000100:00100000:1.0:1788625665.392779:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625665.392786:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845699200:12345-0@lo:400: 00000100:00100000:1.0:1788625665.392827:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845699200:12345-0@lo:400: Request processed in 42us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625665.392834:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625665.392877:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3d180 x1875509845699200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.392887:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845699200:0@lo:400: 00010000:00080000:3.0:1788625665.393056:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b434fcd1180 x1875509845698944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625665.393066:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625665.393073:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788625665.393147:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788625665.393252:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788625665.393257:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b43795a2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788625665.393332:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788625665.393347:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845698944:0@lo:8: 00000100:00100000:3.0:1788625665.393374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699072 00000100:00100000:3.0:1788625665.393379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699072 00000100:00100000:3.0:1788625665.393412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625665.393419:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:6876:x1875509845699072:12345-0@lo:502: 00000100:00100000:3.0:1788625665.393818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:6876:x1875509845699072:12345-0@lo:502: Request processed in 398us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.393825:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625665.393881:0:6876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:6876:1875509845699072:0@lo:502: 00000020:01000000:3.0:1788625665.393907:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625665.393913:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625665.393914:0:6876:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788625665.393918:0:6876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788625665.394021:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788625665.394035:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788625665.394044:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394055:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625665.394065:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788625665.394068:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b4346390000 from 1 10000000:01000000:3.0:1788625665.394070:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788625665.394284:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394294:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394313:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625665.394331:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845699456:0@lo:101: 00000100:00100000:3.0:1788625665.394364:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.394391:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.394407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699456 00000100:00100000:3.0:1788625665.394412:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699456 00000100:00100000:3.0:1788625665.394436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625665.394442:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845699456:12345-0@lo:101: 00010000:00010000:3.0:1788625665.394451:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625665.394464:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13590 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394488:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13590 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394500:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13590 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.394510:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7000, rc 0) 00000100:00100000:3.0:1788625665.394538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845699456:12345-0@lo:101: Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625665.394544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625665.396055:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845699456:0@lo:101: 00010000:00010000:3.0:1788625665.396145:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.396245:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625665.396311:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845699584:0@lo:501: 00000100:00100000:3.0:1788625665.396355:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.396397:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625665.396586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699584 00000100:00100000:2.0:1788625665.396593:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699584 00000100:00100000:2.0:1788625665.396633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625665.396642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845699584:12345-0@lo:501: 00000100:00100000:2.0:1788625665.396890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845699584:12345-0@lo:501: Request processed in 248us (534us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625665.396897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625665.398291:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845699584:0@lo:501: 10000000:01000000:3.0:1788625665.398330:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788625665.398339:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625665.398350:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625665.403800:0:6883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788625665.405801:0:6883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 215402069946ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788625665.450897:0:6884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788625665.450930:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845699840:0@lo:7: 00000100:00100000:1.0:1788625665.451001:0:6884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.451063:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4380771480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625665.451092:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845699712:0@lo:13: 00000100:00100000:1.0:1788625665.451117:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.451172:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699712 00000100:00100000:1.0:1788625665.451180:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699712 00000100:00100000:1.0:1788625665.451240:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625665.451249:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845699712:12345-0@lo:13: 00002000:00000024:1.0:1788625665.451281:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788625665.451326:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845699712:12345-0@lo:13: Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625665.451332:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788625665.451351:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625665.451378:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3d180 x1875509845699712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.451398:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845699712:0@lo:13: 00000100:00100000:3.0:1788625665.451902:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699840 00000100:00100000:3.0:1788625665.451908:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699840 00000100:00100000:3.0:1788625665.451938:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625665.451945:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6884:x1875509845699840:12345-0@lo:7: 00002000:00080000:2.0:1788625665.462871:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788625665.462880:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788625665.463114:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6884:x1875509845699840:12345-0@lo:7: Request processed in 11164us (12107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625665.463128:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625665.463376:0:6884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3fb80 x1875509845699840/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.463393:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845699840:0@lo:7: 00000004:00080000:1.0:1788625665.463408:0:6884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788625665.463447:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845699968:0@lo:5: 00000100:00100000:1.0:1788625665.463482:0:6884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625665.463579:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4380771480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625665.472107:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845699968 00000100:00100000:0.0:1788625665.472134:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845699968 00000100:00100000:0.0:1788625665.472195:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625665.472205:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6884:x1875509845699968:12345-0@lo:5: 00002000:00080000:0.0:1788625665.472234:0:6696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788625665.472238:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788625665.472620:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6884:x1875509845699968:12345-0@lo:5: Request processed in 415us (9135us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788625665.472628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788625665.473004:0:6884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3fb80 x1875509845699968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625665.473024:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845699968:0@lo:5: 00000004:00080000:0.0:1788625665.473037:0:6884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788625665.473218:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845700096:0@lo:700: 00000100:00100000:0.0:1788625665.473258:0:6884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.473340:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625665.475507:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700096 00000100:00100000:3.0:1788625665.475520:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700096 00000100:00100000:3.0:1788625665.475620:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625665.475631:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6884:x1875509845700096:12345-0@lo:700: 00000100:00100000:3.0:1788625665.475695:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1875509845700224:0@lo:700: 00000100:00100000:3.0:1788625665.475766:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625665.475800:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625665.475966:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700224 00000100:00100000:1.0:1788625665.475971:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700224 00000100:00100000:1.0:1788625665.476007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625665.476015:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1875509845700224:12345-0@lo:700: 00000004:00080000:3.0:1788625665.489932:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788625665.521851:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788625665.529332:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1875509845700224:12345-0@lo:700: Request processed in 53309us (53556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625665.529354:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788625665.529465:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4379719500 x1875509845700224/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788625681 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625665.529480:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1875509845700224:0@lo:700: 40000000:02000000:3.0:1788625665.529493:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1788625665.733945:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6884:x1875509845700096:12345-0@lo:700: Request processed in 258306us (260676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625665.733993:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1788625665.734034:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788625665.734045:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788625665.736786:0:6884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea0ad80 x1875509845700096/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.736806:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845700096:0@lo:700: 00000004:02000040:1.0:1788625665.798826:0:6884:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788625665.812132:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845700352:0@lo:5: 00000100:00100000:0.0:1788625665.812203:0:6884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625665.812268:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625665.812321:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700352 00000100:00100000:2.0:1788625665.812330:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700352 00000100:00100000:2.0:1788625665.812394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625665.812405:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6884:x1875509845700352:12345-0@lo:5: 00002000:00080000:0.0:1788625665.831162:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788625665.831185:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788625665.833665:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6884:x1875509845700352:12345-0@lo:5: Request processed in 21255us (21454us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788625665.833677:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788625665.833977:0:6884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea0a680 x1875509845700352/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625681 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.833991:0:6884:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788625665.834007:0:6884:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b436ea0a680 x1875509845700352/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625681 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625665.834018:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6884:1875509845700352:0@lo:5: 00000004:00080000:1.0:1788625665.834033:0:6884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788625666.294261:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625667.315621:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625668.339866:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625669.365994:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625669.601950:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788625670.387984:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625670.643023:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845700736:0@lo:400: 00000100:00100000:0.0:1788625670.643102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625670.643158:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845700608:0@lo:400: 00000100:00100000:3.0:1788625670.643206:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625670.643225:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625670.643236:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845700864:0@lo:400: 00000100:00100000:3.0:1788625670.643241:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845700992:0@lo:400: 00000100:00100000:0.0:1788625670.643275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625670.643293:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625670.644256:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700736 00000100:00100000:2.0:1788625670.644267:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700736 00000100:00100000:2.0:1788625670.644312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700864 00000100:00100000:2.0:1788625670.644315:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700864 00000100:00100000:2.0:1788625670.644349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625670.644358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845700736:12345-0@lo:400: 00000100:00100000:2.0:1788625670.644421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845700736:12345-0@lo:400: Request processed in 64us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625670.644427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625670.644446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625670.644452:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845700864:12345-0@lo:400: 00000100:00100000:2.0:1788625670.644480:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845700864:12345-0@lo:400: Request processed in 28us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625670.644499:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625670.644520:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700608 00000100:00100000:2.0:1788625670.644524:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700608 00000100:00100000:2.0:1788625670.644549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788625670.644555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3310:x1875509845700608:12345-0@lo:400: 00000100:00100000:2.0:1788625670.648404:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3310:x1875509845700608:12345-0@lo:400: Request processed in 3837us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625670.648419:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788625670.648506:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788625670.648554:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea0ad80 x1875509845700864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625670.648570:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845700864:0@lo:400: 00010000:00080000:2.0:1788625670.648584:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea0b100 x1875509845700736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625670.648593:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845700736:0@lo:400: 00000100:00100000:3.0:1788625670.649486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845700608:0@lo:400: 00000100:00100000:3.0:1788625670.649505:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625670.649520:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845700480:0@lo:13: 00000100:00100000:3.0:1788625670.649579:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625670.649672:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700992 00000100:00100000:2.0:1788625670.649680:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700992 00000100:00100000:1.0:1788625670.650509:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845700480 00000100:00100000:1.0:1788625670.650517:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845700480 00000100:00100000:1.0:1788625670.650600:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625670.650611:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875509845700480:12345-0@lo:13: 00002000:00000024:1.0:1788625670.650652:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625670.650705:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875509845700480:12345-0@lo:13: Request processed in 97us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625670.650712:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625670.651591:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625670.651605:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845700992:12345-0@lo:400: 00000100:00100000:2.0:1788625670.651659:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845700992:12345-0@lo:400: Request processed in 59us (8366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625670.651666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788625670.651716:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625670.657849:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3fb80 x1875509845700480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625670.657880:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845700480:0@lo:13: 00010000:00080000:0.0:1788625670.657897:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea09c00 x1875509845700992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625670.657905:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845700992:0@lo:400: 00000001:00080000:2.0:1788625670.773080:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788625671.410917:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625672.439066:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625673.458915:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625674.483805:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625675.511276:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625675.763244:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625675.763270:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845701504:0@lo:400: 00000100:00100000:2.0:1788625675.763271:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845701632:0@lo:400: 00000100:00100000:0.0:1788625675.763439:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625675.763504:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845701120:0@lo:13: 00000100:00100000:0.0:1788625675.763529:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625675.763573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701504 00000100:00100000:0.0:1788625675.763581:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701504 00000100:00100000:0.0:1788625675.763638:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625675.763647:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845701504:12345-0@lo:400: 00000100:00100000:0.0:1788625675.763709:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845701504:12345-0@lo:400: Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625675.763716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625675.763782:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701120 00000100:00100000:0.0:1788625675.763787:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701120 00000100:00100000:0.0:1788625675.765605:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625675.765617:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845701120:12345-0@lo:13: 00002000:00000024:0.0:1788625675.765656:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625675.765745:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845701120:12345-0@lo:13: Request processed in 115us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625675.765752:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788625675.765773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625675.765778:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625675.772579:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625675.772694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845701248:0@lo:400: 00000100:00100000:2.0:1788625675.772757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625675.772788:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625675.772815:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845701376:0@lo:400: 00000100:00100000:2.0:1788625675.772843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625675.772876:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701248 00000100:00100000:2.0:1788625675.772884:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701248 00000100:00100000:2.0:1788625675.772926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625675.772935:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845701248:12345-0@lo:400: 00000100:00100000:2.0:1788625675.772982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845701248:12345-0@lo:400: Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625675.772988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788625675.772997:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701632 00000100:00100000:3.0:1788625675.773002:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701632 00000100:00100000:2.0:1788625675.773019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701376 00000100:00100000:2.0:1788625675.773022:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701376 00000100:00100000:3.0:1788625675.773030:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625675.773036:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845701632:12345-0@lo:400: 00000100:00100000:3.0:1788625675.773080:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845701632:12345-0@lo:400: Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625675.773086:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625675.774276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845701248:0@lo:400: 00010000:00080000:1.0:1788625675.782995:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b434fcd2a00 x1875509845701504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625675.783013:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845701504:0@lo:400: 00010000:00080000:1.0:1788625675.783029:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea09c00 x1875509845701120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625675.783037:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788625675.783062:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845701120:0@lo:13: 00010000:00080000:2.0:1788625675.793936:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b434fcd0380 x1875509845701632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625675.793955:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845701632:0@lo:400: 00000100:00100000:2.0:1788625675.793992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625675.794021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845701376:12345-0@lo:400: 00000100:00100000:2.0:1788625675.794120:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845701376:12345-0@lo:400: Request processed in 119us (21275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625675.794127:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788625675.795781:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b434fcd0a80 x1875509845701376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625675.795808:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845701376:0@lo:400: 00010000:00010000:2.0:1788625676.530875:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625677.554882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625678.581628:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625679.604110:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625680.626875:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625680.883487:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845701888:0@lo:400: 00000100:00100000:2.0:1788625680.883555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625680.883607:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845702016:0@lo:400: 00000100:00100000:1.0:1788625680.883777:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845701760:0@lo:400: 00000100:00100000:1.0:1788625680.883825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625680.883896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701760 00000100:00100000:1.0:1788625680.883904:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701760 00000100:00100000:1.0:1788625680.883950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625680.883960:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845701760:12345-0@lo:400: 00000100:00100000:1.0:1788625680.884011:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845701760:12345-0@lo:400: Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625680.884018:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625680.884078:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845701760:0@lo:400: 00000100:00100000:2.0:1788625680.884770:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625680.884781:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845702272:0@lo:13: 00000100:00100000:2.0:1788625680.884827:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625680.884859:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845702144:0@lo:400: 00000100:00100000:2.0:1788625680.884895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625680.884925:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702144 00000100:00100000:2.0:1788625680.884930:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702144 00000100:00100000:2.0:1788625680.884972:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625680.884980:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845702144:12345-0@lo:400: 00000100:00100000:2.0:1788625680.885020:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845702144:12345-0@lo:400: Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625680.885027:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788625680.885057:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea09c00 x1875509845702144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625680.885068:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845702144:0@lo:400: 00000100:00100000:0.0:1788625680.885209:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845701888 00000100:00100000:0.0:1788625680.885214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845701888 00000100:00100000:0.0:1788625680.885256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625680.885263:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845701888:12345-0@lo:400: 00000100:00100000:0.0:1788625680.885301:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845701888:12345-0@lo:400: Request processed in 39us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625680.885307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625680.885326:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702272 00000100:00100000:0.0:1788625680.885329:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702272 00000100:00100000:0.0:1788625680.885352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625680.885359:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845702272:12345-0@lo:13: 00000100:00100000:3.0:1788625680.885678:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788625680.886005:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625680.886043:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845702272:12345-0@lo:13: Request processed in 686us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625680.886050:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788625680.886658:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625680.886670:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702016 00000100:00100000:0.0:1788625680.886684:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702016 00000100:00080000:1.0:1788625680.886775:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625680.886859:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625680.886866:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845702016:12345-0@lo:400: 00000100:00100000:0.0:1788625680.886912:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845702016:12345-0@lo:400: Request processed in 47us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625680.886916:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788625680.886960:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea0bb80 x1875509845702016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625680.886970:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845702016:0@lo:400: 00010000:00080000:0.0:1788625680.887313:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4379718e00 x1875509845702272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625680.887333:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845702272:0@lo:13: 00010000:00080000:0.0:1788625680.887347:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea09180 x1875509845701888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625680.887356:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845701888:0@lo:400: 00000020:01000004:1.0:1788625681.459994:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788625681.459997:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788625681.460802:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b437fc51000 00000020:01000004:1.0:1788625681.460823:0:7636:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788625681.460836:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788625681.460851:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b43795f0000) 00000020:00000080:1.0:1788625681.460869:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788625681.473470:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788625681.473773:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788625681.496936:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788625681.501945:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788625681.501979:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788625681.502037:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788625681.502066:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788625681.502418:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788625681.502430:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788625681.502440:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8aede7274cb135a5 00000020:01000004:3.0:1788625681.502448:0:7636:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788625681.502469:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788625681.502473:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788625681.502479:0:7636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788625681.502500:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788625681.502504:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788625681.518709:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788625681.518882:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788625681.518890:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788625681.518892:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788625681.518893:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625681.518894:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625681.518896:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625681.518897:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625681.518898:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625681.518900:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625681.518902:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625681.518903:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625681.518904:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625681.518908:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788625681.518910:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788625681.518912:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788625681.518912:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625681.518913:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625681.518914:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625681.518915:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625681.518916:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625681.518917:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625681.518918:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625681.518919:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625681.518920:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625681.518946:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788625681.518964:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845702400:0@lo:253: 00000100:00100000:1.0:1788625681.519040:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.519089:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.519151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702400 00000100:00100000:3.0:1788625681.519158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702400 00000100:00100000:3.0:1788625681.519235:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625681.519244:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:7636:x1875509845702400:12345-0@lo:253: 20000000:01000000:3.0:1788625681.519278:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788625681.519282:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788625681.519287:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788625681.519290:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788625681.520170:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625681.520388:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788625681.520401:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788625681.520438:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788625681.520445:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788625681.520473:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788625681.520514:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788625681.520837:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788625681.520855:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1788625681.520858:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788625681.520892:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788625681.520899:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788625681.520957:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788625681.520966:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1788625681.520998:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788625681.521008:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788625681.521039:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788625681.521088:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788625681.521823:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788625681.521836:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1788625681.521838:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788625681.521858:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788625681.521864:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788625681.521892:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788625681.521899:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1788625681.521925:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788625681.521931:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788625681.521956:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788625681.521974:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788625681.521983:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788625681.521985:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788625681.521990:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788625681.521991:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788625681.521992:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788625681.522002:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788625681.522004:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788625681.522024:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788625681.522026:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788625681.522627:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788625681.522694:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788625681.522927:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788625681.523339:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788625681.523389:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788625681.523425:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788625681.523437:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788625681.523439:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788625681.524363:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788625681.524431:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788625681.524465:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788625681.524872:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788625681.524918:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788625681.524974:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788625681.524987:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788625681.524990:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788625681.525292:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788625681.525489:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788625681.525526:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788625681.525615:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788625681.525628:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788625681.525630:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788625681.526164:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788625681.526212:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788625681.526265:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788625681.526463:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788625681.526490:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788625681.526572:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788625681.526592:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788625681.526613:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526632:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526640:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13520 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526648:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1354a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526655:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13566 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526671:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13590 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526679:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526717:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.526868:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 16 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.526884:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702528:0@lo:104: 00000100:00100000:3.0:1788625681.526951:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625681.527042:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.527050:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 16 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.527059:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702656:0@lo:104: 00010000:00010000:3.0:1788625681.527085:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.527093:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 16 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.527100:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702784:0@lo:104: 00010000:00010000:3.0:1788625681.527121:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.527135:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 16 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.527143:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702912:0@lo:104: 00010000:00010000:3.0:1788625681.527167:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.527172:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 16 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.527177:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845703040:0@lo:104: 00000100:00100000:3.0:1788625681.527186:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.527229:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788625681.527243:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.527283:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.527318:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.527331:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702528 00000100:00100000:0.0:1788625681.527336:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702528 00000100:00100000:0.0:1788625681.527365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702656 00000100:00100000:0.0:1788625681.527368:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702656 00000100:00100000:0.0:1788625681.527378:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702784 00000100:00100000:0.0:1788625681.527380:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702784 00000100:00100000:0.0:1788625681.527391:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625681.527399:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4348734c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5834:x1875509845702528:12345-0@lo:104: 00010000:00010000:0.0:1788625681.527412:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527483:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625681.527490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4348734c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:5834:x1875509845702528:12345-0@lo:104: Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.527496:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625681.527536:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625681.527543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5834:x1875509845702656:12345-0@lo:104: 00010000:00010000:0.0:1788625681.527551:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527594:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625681.527599:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5834:x1875509845702656:12345-0@lo:104: Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.527605:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625681.527618:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625681.527624:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5834:x1875509845702784:12345-0@lo:104: 00010000:00010000:0.0:1788625681.527632:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527663:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788625681.527668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5834:x1875509845702784:12345-0@lo:104: Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.527673:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788625681.527689:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625681.527695:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527701:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625681.527708:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527714:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.527720:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.527723:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625681.527763:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527769:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625681.527784:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb13590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527801:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625681.527805:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527810:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625681.527812:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527818:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.527833:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.527838:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625681.527852:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527857:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625681.527870:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb13566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1356d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527888:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625681.527891:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527896:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340031400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625681.527899:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527904:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.527911:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.527917:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625681.527935:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527941:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625681.527946:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527952:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340031400/0x8aede7274cb1354a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13551 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.527962:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.527964:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.527965:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625681.527977:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845703168:0@lo:103: 00000100:00100000:0.0:1788625681.528007:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625681.528103:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702528:0@lo:104: 00000100:00100000:3.0:1788625681.528110:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702656:0@lo:104: 00000100:00100000:3.0:1788625681.528116:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702784:0@lo:104: 00010000:00010000:1.0:1788625681.528163:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625681.528173:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845703296:0@lo:103: 00000100:00100000:1.0:1788625681.528192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.528217:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625681.528220:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845703424:0@lo:103: 00000100:00100000:1.0:1788625681.528235:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625681.528285:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703168 00000100:00100000:3.0:1788625681.528289:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703168 00010000:00010000:3.0:1788625681.528304:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.528313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703296 00000100:00100000:3.0:1788625681.528315:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703296 00010000:00010000:3.0:1788625681.528320:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 18 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.528325:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703424 00000100:00100000:3.0:1788625681.528327:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703424 00010000:00010000:3.0:1788625681.528331:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.528344:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625681.528347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845703168:12345-0@lo:103: 00010000:00010000:3.0:1788625681.528355:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625681.528358:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528367:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528380:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7000/0x8aede7274cb13597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13590 expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528391:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625681.528428:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3309:x1875509845703168:12345-0@lo:103: Request processed in 80us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.528432:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625681.528442:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625681.528446:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3310:x1875509845703296:12345-0@lo:103: 00010000:00010000:3.0:1788625681.528450:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625681.528453:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 17 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528458:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 17 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528478:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb1356d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13566 expref: 17 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528491:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625681.528509:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3310:x1875509845703296:12345-0@lo:103: Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.528513:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625681.528521:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625681.528524:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3310:x1875509845703424:12345-0@lo:103: 00010000:00010000:3.0:1788625681.528529:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625681.528533:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528541:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528550:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb13551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1354a expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.528558:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625681.528589:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3310:x1875509845703424:12345-0@lo:103: Request processed in 63us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.528595:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625681.528687:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845703424:0@lo:103: 00000100:00100000:3.0:1788625681.528692:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845703296:0@lo:103: 00000100:00100000:1.0:1788625681.528802:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845703168:0@lo:103: 00010000:00010000:3.0:1788625681.528875:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625681.530834:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.530852:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845702912 00000100:00100000:0.0:1788625681.530854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703040 00000100:00100000:2.0:1788625681.530859:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845702912 00000100:00100000:0.0:1788625681.530859:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703040 00000100:00100000:0.0:1788625681.530898:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625681.530907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5834:x1875509845703040:12345-0@lo:104: 00010000:00010000:0.0:1788625681.530923:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531029:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625681.531035:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:5834:x1875509845703040:12345-0@lo:104: Request processed in 130us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.531042:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625681.531150:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845703040:0@lo:104: 00000100:00100000:0.0:1788625681.531192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625681.531200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5834:x1875509845702912:12345-0@lo:104: 00010000:00010000:0.0:1788625681.531208:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531281:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625681.531285:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5834:x1875509845702912:12345-0@lo:104: Request processed in 88us (3966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.531289:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788625681.531303:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625681.531307:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531312:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3600 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625681.531315:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531321:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.531325:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.531329:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625681.531362:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531369:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625681.531393:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531400:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3600/0x8aede7274cb134f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531421:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625681.531424:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531429:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6600 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625681.531432:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531439:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.531445:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.531450:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625681.531466:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531472:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625681.531477:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531483:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb13520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13527 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531497:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.531499:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.531500:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625681.531505:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845703552:0@lo:103: 00010000:00010000:1.0:1788625681.531535:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625681.531542:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.531550:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845703680:0@lo:103: 00000100:00100000:1.0:1788625681.531583:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.531630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703552 00000100:00100000:0.0:1788625681.531639:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703552 00010000:00010000:0.0:1788625681.531658:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625681.531681:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703680 00000100:00100000:0.0:1788625681.531684:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703680 00010000:00010000:0.0:1788625681.531695:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625681.531707:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625681.531714:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3308:x1875509845703552:12345-0@lo:103: 00010000:00010000:0.0:1788625681.531723:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625681.531747:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.531757:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.532113:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875509845702912:0@lo:104: 00010000:00010000:3.0:1788625681.532142:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.532164:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788625681.532171:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788625681.532207:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340030600/0x8aede7274cb134fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb134f6 expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532223:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625681.532261:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3308:x1875509845703552:12345-0@lo:103: Request processed in 548us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.532268:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625681.532280:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625681.532286:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845703680:12345-0@lo:103: 00010000:00010000:0.0:1788625681.532294:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625681.532298:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 13 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532320:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 13 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532330:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031000/0x8aede7274cb13527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13520 expref: 13 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532341:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532349:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532360:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532367:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532374:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532380:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532386:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625681.532389:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532397:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532423:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.532433:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625681.532441:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.532448:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625681.532454:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3309:x1875509845703680:12345-0@lo:103: Request processed in 169us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.532460:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625681.532531:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845703552:0@lo:103: 00010000:00010000:2.0:1788625681.532666:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7800/0x8aede7274cb135ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625681.532680:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788625681.532761:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845703680:0@lo:103: 00000100:00100000:1.0:1788625681.564445:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:7636:x1875509845702400:12345-0@lo:253: Request processed in 45192us (45395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.564459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788625681.564469:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845702400:0@lo:253: 10000000:01000000:2.0:1788625681.564484:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788625681.564488:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625681.564489:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625681.564490:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625681.564491:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788625681.564492:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625681.564494:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625681.564495:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625681.564497:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788625681.564498:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625681.564500:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788625681.564519:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b437fc51000 from lustre-OST0001 10000000:01000000:2.0:1788625681.564542:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788625681.564545:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788625681.564552:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b4346390000 local copy 10000000:01000000:2.0:1788625681.564556:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788625681.564600:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.564610:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.564620:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625681.564635:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845703808:0@lo:101: 00000100:00100000:2.0:1788625681.564672:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.564703:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625681.564710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703808 00000100:00100000:1.0:1788625681.564717:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703808 00000100:00100000:1.0:1788625681.564820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625681.564829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+11:7636:x1875509845703808:12345-0@lo:101: 00010000:00010000:1.0:1788625681.564841:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625681.564853:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2000/0x8aede7274cb135ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb135b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.564873:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2000/0x8aede7274cb135ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb135b3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.564881:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2000/0x8aede7274cb135ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135b3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.564887:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2000, rc 0) 00000100:00100000:1.0:1788625681.564914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845703808:12345-0@lo:101: Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.564919:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625681.564943:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845703808:0@lo:101: 00010000:00010000:2.0:1788625681.564956:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.564965:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625681.565048:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845703936:0@lo:501: 00000100:00100000:2.0:1788625681.565073:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.565098:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625681.565158:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845703936 00000100:00100000:1.0:1788625681.565162:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845703936 00000100:00100000:1.0:1788625681.565215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625681.565221:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845703936:12345-0@lo:501: 00000100:00100000:1.0:1788625681.565389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845703936:12345-0@lo:501: Request processed in 167us (314us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625681.565396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788625681.565416:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845703936:0@lo:501: 10000000:01000000:2.0:1788625681.565427:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788625681.565454:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788625681.565459:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565467:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565473:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565498:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625681.565517:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b437fc51000 10000000:01000000:2.0:1788625681.565522:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625681.565522:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788625681.565526:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:0.0:1788625681.565529:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625681.565533:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625681.565537:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:0.0:1788625681.565537:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc1c72c20) 10000000:01000000:2.0:1788625681.565540:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 10000000:00010000:0.0:1788625681.565541:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.565548:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565554:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565574:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625681.565575:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625681.565581:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625681.565583:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625681.565594:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704064:0@lo:101: 00010000:00010000:0.0:1788625681.565597:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.565603:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788625681.565618:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625681.565620:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.565630:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371017800/0x8aede7274cb135b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8aede7274cb135ba expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.565650:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.565652:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625681.565653:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625681.565698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704064 00000100:00100000:3.0:1788625681.565702:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704064 00000100:00100000:2.0:1788625681.565705:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344ddad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.565781:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845704192:0@lo:103: 00000100:00100000:2.0:1788625681.565818:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.565826:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788625681.565833:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704064:12345-0@lo:101: 00010000:00010000:1.0:1788625681.565841:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625681.565849:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb135c1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.565863:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.565871:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.565878:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2c00, rc 0) 00000100:00100000:1.0:1788625681.565911:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704064:12345-0@lo:101: Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.565917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625681.565958:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704064:0@lo:101: 00010000:00010000:2.0:1788625681.565969:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625681.565977:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625681.566031:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704320:0@lo:501: 00000100:00100000:2.0:1788625681.566056:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.566075:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344ddad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.566176:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704320 00000100:00100000:3.0:1788625681.566180:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704320 00000100:00100000:3.0:1788625681.566195:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625681.566202:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704320:12345-0@lo:501: 00000100:00100000:3.0:1788625681.566332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704320:12345-0@lo:501: Request processed in 129us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.566338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625681.566361:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704320:0@lo:501: 00000100:00100000:2.0:1788625681.566394:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704448:0@lo:503: 00000100:00100000:2.0:1788625681.566429:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.566446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704448 00000100:00100000:2.0:1788625681.566448:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344ddad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625681.566449:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704448 00000100:00100000:0.0:1788625681.566467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625681.566473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704448:12345-0@lo:503: 00000100:00100000:0.0:1788625681.566609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704448:12345-0@lo:503: Request processed in 135us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.566615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625681.566645:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704192 00000100:00100000:0.0:1788625681.566648:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704192 00000100:00100000:0.0:1788625681.566677:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625681.566684:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3310:x1875509845704192:12345-0@lo:103: 00010000:00010000:0.0:1788625681.566693:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625681.566704:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2000/0x8aede7274cb135ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb135b3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.566716:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625681.566769:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3310:x1875509845704192:12345-0@lo:103: Request processed in 86us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.566775:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625681.566781:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845704192:0@lo:103: 00000100:00100000:2.0:1788625681.566844:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704448:0@lo:503: 00000040:00080000:2.0:1788625681.567045:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625681.567232:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704576:0@lo:502: 00000100:00100000:2.0:1788625681.567265:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.567336:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344ddad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625681.567547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704576 00000100:00100000:1.0:1788625681.567551:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704576 00000100:00100000:1.0:1788625681.567585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788625681.567590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704576:12345-0@lo:502: 00000100:00100000:1.0:1788625681.567692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704576:12345-0@lo:502: Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.567697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625681.567764:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704576:0@lo:502: 00000040:00080000:2.0:1788625681.567947:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788625681.567977:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788625681.567993:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788625681.568021:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788625681.568038:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788625681.568065:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788625681.568249:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704704:0@lo:502: 00000100:00100000:2.0:1788625681.568277:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625681.568328:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344ddad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.568357:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704704 00000100:00100000:3.0:1788625681.568406:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704704 00000100:00100000:3.0:1788625681.568430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788625681.568440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704704:12345-0@lo:502: 00000100:00100000:3.0:1788625681.568568:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704704:12345-0@lo:502: Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.568575:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625681.568600:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704704:0@lo:502: 00000040:00080000:2.0:1788625681.568679:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788625681.568686:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788625681.569056:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625681.569063:0:7644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788625681.569069:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625681.569072:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788625681.569078:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625681.569091:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b43795f19c0) 00000020:00000080:1.0:1788625681.569110:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788625681.569116:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625681.569177:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b437fc51000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788625681.569182:0:7644:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625681.569187:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8aede7274cb135d6 00010000:00010000:1.0:1788625681.571476:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788625681.571804:0:7644:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788625681.573223:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788625681.573415:0:7644:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788625681.579549:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788625681.581920:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788625681.583525:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788625681.583536:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625681.583542:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625681.583544:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788625681.583547:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625681.583551:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625681.583552:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788625681.583555:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788625681.583575:0:7644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788625681.583624:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625681.583627:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625681.583628:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788625681.583631:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788625681.583974:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788625681.584007:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788625681.584032:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.584045:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625681.584062:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437fc51000 from 1 10000000:01000000:1.0:1788625681.584065:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625681.584251:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.584260:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.584275:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625681.584299:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704832:0@lo:101: 00000100:00100000:1.0:1788625681.584361:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.584549:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625681.585772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704832 00000100:00100000:0.0:1788625681.585782:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704832 00000100:00100000:0.0:1788625681.585834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788625681.585844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:7636:x1875509845704832:12345-0@lo:101: 00010000:00010000:0.0:1788625681.585858:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625681.585879:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb135dd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.585906:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb135dd expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.585918:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135dd expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.585928:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031000, rc 0) 00000100:00100000:0.0:1788625681.585987:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704832:12345-0@lo:101: Request processed in 145us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.585994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788625681.586116:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704832:0@lo:101: 00010000:00010000:1.0:1788625681.586132:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.586141:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625681.586235:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704960:0@lo:501: 00000100:00100000:1.0:1788625681.586257:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.586286:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.586292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845704960 00000100:00100000:2.0:1788625681.586296:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845704960 00000100:00100000:2.0:1788625681.586324:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625681.586331:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704960:12345-0@lo:501: 00000100:00100000:2.0:1788625681.586571:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845704960:12345-0@lo:501: Request processed in 231us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625681.586584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788625681.586595:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845704960:0@lo:501: 00000100:00100000:1.0:1788625681.586619:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705088:0@lo:503: 00000100:00100000:1.0:1788625681.586666:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.586683:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625681.586705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705088 00000100:00100000:0.0:1788625681.586709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705088 00000100:00100000:0.0:1788625681.586757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788625681.586764:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705088:12345-0@lo:503: 00000100:00100000:0.0:1788625681.587049:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705088:12345-0@lo:503: Request processed in 285us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.587056:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788625681.587238:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705088:0@lo:503: 00000040:00080000:1.0:1788625681.587634:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625681.587773:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705216:0@lo:502: 00000100:00100000:1.0:1788625681.587885:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.587960:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.588005:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705216 00000100:00100000:2.0:1788625681.588011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705216 00000100:00100000:2.0:1788625681.588247:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625681.588256:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705216:12345-0@lo:502: 00000100:00100000:2.0:1788625681.588569:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705216:12345-0@lo:502: Request processed in 305us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625681.588576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625681.589668:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705216:0@lo:502: 00000040:00080000:3.0:1788625681.589952:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788625681.590011:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788625681.590043:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705344:0@lo:502: 00000100:00100000:3.0:1788625681.590096:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625681.590135:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625681.590164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705344 00000100:00100000:1.0:1788625681.590171:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705344 00000100:00100000:1.0:1788625681.590213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625681.590220:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705344:12345-0@lo:502: 00000100:00100000:1.0:1788625681.590367:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705344:12345-0@lo:502: Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.590374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625681.590627:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705344:0@lo:502: 00000040:00080000:3.0:1788625681.590721:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788625681.590783:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788625681.591534:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625681.591543:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625681.591545:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625681.591550:0:7648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b437fc51000 00000020:00000080:0.0:1788625681.591551:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625681.591580:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625681.591582:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625681.591583:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788625681.591585:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788625681.591630:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788625681.591703:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625681.591723:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.591856:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625681.591890:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788625681.591892:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b437fc51000 10000000:01000000:3.0:1788625681.591895:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b437fc51000 10000000:01000000:3.0:1788625681.591898:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625681.591901:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b437fc51000 from 1 10000000:01000000:3.0:1788625681.591903:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625681.591927:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.591940:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.591947:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625681.591960:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705472:0@lo:101: 00000100:00100000:3.0:1788625681.591996:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625681.592053:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625681.592077:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705472 00000100:00100000:1.0:1788625681.592133:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705472 00000100:00100000:1.0:1788625681.592268:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625681.592275:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845705472:12345-0@lo:101: 00010000:00010000:1.0:1788625681.592284:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625681.592293:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb135eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.592308:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb135eb expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.592315:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135eb expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.592321:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3200, rc 0) 00000100:00100000:1.0:1788625681.592355:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705472:12345-0@lo:101: Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.592361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625681.592390:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705472:0@lo:101: 00010000:00010000:0.0:1788625681.592407:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.592417:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625681.592482:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705600:0@lo:501: 00000100:00100000:0.0:1788625681.592501:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.592522:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.592540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705600 00000100:00100000:2.0:1788625681.592544:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705600 00000100:00100000:2.0:1788625681.592613:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788625681.592620:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705600:12345-0@lo:501: 00000100:00100000:2.0:1788625681.592854:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705600:12345-0@lo:501: Request processed in 234us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625681.592861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625681.592875:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705600:0@lo:501: 00000100:00100000:0.0:1788625681.592897:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705728:0@lo:503: 00000100:00100000:0.0:1788625681.592933:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.593172:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.593286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705728 00000100:00100000:3.0:1788625681.593290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705728 00000100:00100000:3.0:1788625681.593306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625681.593310:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705728:12345-0@lo:503: 00000100:00100000:3.0:1788625681.593434:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705728:12345-0@lo:503: Request processed in 122us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.593441:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625681.593453:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705728:0@lo:503: 00000040:00080000:0.0:1788625681.593677:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625681.593744:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705856:0@lo:502: 00000100:00100000:0.0:1788625681.593778:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.593794:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.593874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705856 00000100:00100000:3.0:1788625681.593879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705856 00000100:00100000:3.0:1788625681.593928:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625681.593934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705856:12345-0@lo:502: 00000100:00100000:3.0:1788625681.594040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705856:12345-0@lo:502: Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.594063:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705856:0@lo:502: 00000100:00100000:3.0:1788625681.594220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000040:00080000:0.0:1788625681.594299:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788625681.594341:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788625681.594380:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788625681.594410:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788625681.594427:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788625681.594449:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788625681.594466:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788625681.594481:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788625681.594515:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788625681.594532:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788625681.594547:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788625681.594590:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788625681.594610:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788625681.594627:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788625681.594671:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788625681.594706:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788625681.595251:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788625681.595306:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788625681.595332:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788625681.595354:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788625681.595419:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788625681.595462:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788625681.595488:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788625681.595521:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788625681.595545:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788625681.595579:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788625681.595615:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788625681.595658:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788625681.595695:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788625681.595760:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788625681.595791:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788625681.595814:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788625681.595836:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788625681.595869:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788625681.595893:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788625681.595994:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788625681.596019:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788625681.596226:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705984:0@lo:502: 00000100:00100000:1.0:1788625681.596331:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.596465:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625681.596862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845705984 00000100:00100000:2.0:1788625681.596868:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845705984 00000100:00100000:2.0:1788625681.596929:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625681.596936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705984:12345-0@lo:502: 00000100:00100000:2.0:1788625681.597108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845705984:12345-0@lo:502: Request processed in 172us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625681.597113:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788625681.597177:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845705984:0@lo:502: 00000040:00080000:1.0:1788625681.597236:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788625681.597243:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788625681.597672:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788625681.597694:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b4379788000) 00000020:00000080:1.0:1788625681.597713:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788625681.597809:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b437fc51000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625681.597812:0:7649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b437fc51000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625681.597814:0:7649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b437fc51000 3 00010000:00080000:1.0:1788625681.597840:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b4379795000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1788625681.599317:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788625681.599485:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788625681.599515:0:7649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788625681.599526:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8aede7274cb13600 00000100:00080000:1.0:1788625681.599536:0:7649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625681.599541:0:7649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b4379795000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1788625681.599586:0:7649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b4377f3f800 x1875509845706112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625681.599672:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845706112:0@lo:38: 00000100:00100000:3.0:1788625681.599760:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625681.599883:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788625681.600939:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625681.600955:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845706240:0@lo:400: 00000100:00100000:1.0:1788625681.600999:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.601033:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845706496:0@lo:400: 00000100:00100000:1.0:1788625681.601058:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.601066:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845706368:0@lo:400: 00000100:00100000:0.0:1788625681.601093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.601130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706112 00000100:00100000:0.0:1788625681.601136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706112 00000100:00100000:0.0:1788625681.601164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706240 00000100:00100000:0.0:1788625681.601167:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706240 00000100:00100000:0.0:1788625681.601187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706368 00000100:00100000:0.0:1788625681.601190:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706368 00000100:00100000:0.0:1788625681.601203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625681.601211:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845706240:12345-0@lo:400: 00000100:00100000:0.0:1788625681.601258:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845706240:12345-0@lo:400: Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.601266:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625681.601280:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625681.601287:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845706368:12345-0@lo:400: 00000100:00100000:0.0:1788625681.601314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845706368:12345-0@lo:400: Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.601320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625681.601330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625681.601334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875509845706112:12345-0@lo:38: 00010000:00080000:0.0:1788625681.601353:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788625681.601448:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8aede7274cb13607 00000004:00100000:0.0:1788625681.601461:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625681.601489:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9b434f8c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625681.602788:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875509845706112:12345-0@lo:38: Request processed in 1447us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.602798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788625681.602849:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3ce00 x1875509845706368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788625681.602989:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3f800 x1875509845706112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625681.603014:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625681.603023:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788625681.603030:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788625681.603035:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625681.603037:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625681.603043:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845706112:0@lo:38: 00000100:00100000:3.0:1788625681.603236:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706496 00000100:00100000:3.0:1788625681.603243:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706496 00000100:00100000:0.0:1788625681.603477:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845706368:0@lo:400: 00010000:00080000:0.0:1788625681.603515:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3ed80 x1875509845706240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625681.603522:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845706240:0@lo:400: 00000100:00100000:3.0:1788625681.604081:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625681.604094:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845706496:12345-0@lo:400: 00000100:00100000:3.0:1788625681.604168:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845706496:12345-0@lo:400: Request processed in 79us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.604175:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788625681.604209:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4377f3d500 x1875509845706496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625681.604219:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845706496:0@lo:400: 00000040:00080000:0.0:1788625681.608076:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788625681.608198:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788625681.608224:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625681.608280:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.608293:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625681.608344:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625681.608346:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625681.608347:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625681.608348:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625681.608349:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625681.608350:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625681.608351:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625681.608352:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625681.608358:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625681.608370:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625681.608372:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625681.608375:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788625681.608377:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625681.608379:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625681.608380:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625681.608380:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625681.608381:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625681.608382:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625681.608383:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625681.608384:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625681.608385:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625681.608385:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625681.608386:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625681.608410:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788625681.608426:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845706624:0@lo:253: 00000100:00100000:0.0:1788625681.608490:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.608523:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625681.608585:0:7651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1875509845706752:0@lo:901: 00000100:00100000:0.0:1788625681.608631:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.608673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706752 00000100:00100000:0.0:1788625681.608680:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706752 00000100:00100000:0.0:1788625681.608723:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625681.608765:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1875509845706752:12345-0@lo:901: 00000100:00100000:0.0:1788625681.609084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1875509845706752:12345-0@lo:901: Request processed in 319us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625681.609091:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788625681.609111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625681.609121:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5c540 going to sleep for 11 seconds 00010000:00080000:0.0:1788625681.609142:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b436ea09880 x1875509845706752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788625697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625681.609154:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1875509845706752:0@lo:901: 00000100:00100000:3.0:1788625681.609429:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706624 00000100:00100000:3.0:1788625681.609434:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706624 00000100:00100000:3.0:1788625681.609506:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788625681.609513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7636:x1875509845706624:12345-0@lo:253: 20000000:01000000:3.0:1788625681.609534:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788625681.609547:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788625681.650821:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788625681.656817:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788625681.656830:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788625681.657516:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625681.657523:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625681.657544:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.657557:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.657574:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.657612:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625681.657626:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625681.657640:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845706880:0@lo:104: 00000100:00100000:0.0:1788625681.657702:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625681.657902:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625681.657977:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845706880 00000100:00100000:3.0:1788625681.657985:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845706880 00000100:00100000:3.0:1788625681.658025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625681.658035:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845706880:12345-0@lo:104: 00010000:00010000:3.0:1788625681.658123:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625681.658256:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625681.658263:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:5857:x1875509845706880:12345-0@lo:104: Request processed in 230us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625681.658270:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788625681.658329:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625681.658336:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658343:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625681.658347:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658356:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625681.658373:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625681.658389:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625681.658422:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658428:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625681.658445:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658452:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d2400/0x8aede7274cb13558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1355f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658470:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625681.658473:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625681.658474:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625681.658485:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845707008:0@lo:103: 00000100:00100000:1.0:1788625681.658519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625681.658569:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707008 00000100:00100000:1.0:1788625681.658573:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707008 00010000:00010000:1.0:1788625681.658592:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 15 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625681.658614:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625681.658621:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3310:x1875509845707008:12345-0@lo:103: 00010000:00010000:1.0:1788625681.658632:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625681.658637:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 15 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658647:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 15 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658669:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658676:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625681.658689:0:7642:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003335897s 00010000:00010000:1.0:1788625681.658693:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658700:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658707:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658713:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658718:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340030600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625681.658722:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658756:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658765:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658776:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625681.658804:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3310:x1875509845707008:12345-0@lo:103: Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.658816:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788625681.658879:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371017e00/0x8aede7274cb1355f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13558 expref: 14 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625681.658889:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875509845706880:0@lo:104: 00010000:00010000:1.0:1788625681.658905:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658912:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658916:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625681.658919:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340030600/0x8aede7274cb1360e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625681.658937:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845707008:0@lo:103: 00000100:00100000:1.0:1788625681.676789:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:7636:x1875509845706624:12345-0@lo:253: Request processed in 67265us (68287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625681.676803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625681.676976:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7636:1875509845706624:0@lo:253: 10000000:01000000:0.0:1788625681.676989:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788625681.676992:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625681.676994:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625681.676995:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625681.676996:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625681.676998:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625681.676999:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625681.677000:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625681.677001:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625681.677002:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625681.677016:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625681.677017:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625681.677030:0:7636:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788625681.688301:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625681.688628:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625681.689010:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625681.689753:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625681.689990:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625681.690509:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788625681.693221:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788625681.931766:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788625681.931772:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788625681.931799:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788625681.931855:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788625681.931871:0:7636:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788625681.931899:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788625682.677093:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625683.701205:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625684.726130:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625685.746935:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625686.004021:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625686.004047:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845707136:0@lo:13: 00000100:00100000:1.0:1788625686.004113:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625686.004247:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707136 00000100:00100000:0.0:1788625686.004255:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707136 00000100:00100000:0.0:1788625686.004330:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625686.004341:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845707136:12345-0@lo:13: 00002000:00000024:0.0:1788625686.004374:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625686.004422:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845707136:12345-0@lo:13: Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625686.004434:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788625686.004475:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea0b100 x1875509845707136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625686.004508:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845707136:0@lo:13: 00000100:00080000:1.0:1788625686.004670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788625686.770906:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625687.037745:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845707520:0@lo:400: 00000100:00100000:3.0:1788625687.037812:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.037876:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707520 00000100:00100000:3.0:1788625687.037882:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707520 00000100:00100000:3.0:1788625687.037929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625687.037938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845707520:12345-0@lo:400: 00000100:00100000:3.0:1788625687.037984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845707520:12345-0@lo:400: Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.037991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788625687.038027:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718000 x1875509845707520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625687.038041:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845707520:0@lo:400: 00000100:00100000:3.0:1788625687.038068:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625687.038074:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845707648:0@lo:400: 00000100:00100000:3.0:1788625687.038097:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.038361:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845707392:0@lo:400: 00000100:00100000:1.0:1788625687.038389:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.038408:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625687.038413:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845707264:0@lo:400: 00000100:00100000:1.0:1788625687.038435:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.038453:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845707776:0@lo:400: 00000100:00100000:1.0:1788625687.038486:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625687.038507:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625687.038517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707392 00000100:00100000:1.0:1788625687.038520:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707392 00000100:00100000:1.0:1788625687.038541:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707776 00000100:00100000:1.0:1788625687.038544:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707776 00000100:00100000:1.0:1788625687.038563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625687.038568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845707392:12345-0@lo:400: 00000100:00100000:1.0:1788625687.038598:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845707392:12345-0@lo:400: Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.038618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625687.038631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625687.038637:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845707776:12345-0@lo:400: 00000100:00100000:1.0:1788625687.038659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845707776:12345-0@lo:400: Request processed in 23us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.038665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788625687.038680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788625687.038696:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718a80 x1875509845707776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625687.038707:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845707776:0@lo:400: 00010000:00080000:1.0:1788625687.038716:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379719880 x1875509845707392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625687.038724:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845707392:0@lo:400: 00000100:00100000:1.0:1788625687.039375:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707648 00000100:00100000:1.0:1788625687.039380:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707648 00000100:00100000:1.0:1788625687.039408:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625687.039415:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845707648:12345-0@lo:400: 00000100:00100000:1.0:1788625687.039452:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845707648:12345-0@lo:400: Request processed in 37us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.039458:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625687.039503:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718000 x1875509845707648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625687.039513:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845707648:0@lo:400: 00000100:00100000:2.0:1788625687.039600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707264 00000100:00100000:2.0:1788625687.039604:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707264 00000100:00100000:2.0:1788625687.039636:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625687.039643:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845707264:12345-0@lo:400: 00000100:00100000:2.0:1788625687.039680:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845707264:12345-0@lo:400: Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.039687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625687.039766:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845707264:0@lo:400: 10000000:01000000:0.0:1788625687.545177:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625687.545186:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4377f6e800 from 30 10000000:01000000:0.0:1788625687.545192:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625687.545243:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.545256:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.545268:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625687.545293:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845707904:0@lo:101: 00000100:00100000:0.0:1788625687.545360:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625687.545492:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.545593:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845707904 00000100:00100000:1.0:1788625687.545600:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845707904 00000100:00100000:1.0:1788625687.545698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788625687.545709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845707904:12345-0@lo:101: 00010000:00010000:1.0:1788625687.545722:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625687.545750:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13615 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.545772:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13615 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.545783:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13615 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.545792:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3a00, rc 0) 00000100:00100000:1.0:1788625687.545838:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845707904:12345-0@lo:101: Request processed in 132us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.545845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625687.545918:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845707904:0@lo:101: 00010000:00010000:0.0:1788625687.545938:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.545948:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625687.545999:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708032:0@lo:501: 00000100:00100000:0.0:1788625687.546022:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625687.546111:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.546145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708032 00000100:00100000:3.0:1788625687.546150:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708032 00000100:00100000:3.0:1788625687.546170:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625687.546177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845708032:12345-0@lo:501: 00000100:00100000:3.0:1788625687.546656:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845708032:12345-0@lo:501: Request processed in 479us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.546663:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788625687.546718:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708032:0@lo:501: 00000100:00100000:0.0:1788625687.546761:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708160:0@lo:503: 00000100:00100000:1.0:1788625687.547829:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.548161:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.548247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708160 00000100:00100000:0.0:1788625687.548255:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708160 00000100:00100000:0.0:1788625687.548373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788625687.548383:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845708160:12345-0@lo:503: 00000100:00100000:0.0:1788625687.549103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845708160:12345-0@lo:503: Request processed in 721us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.549111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625687.549182:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708160:0@lo:503: 00000100:00100000:1.0:1788625687.550346:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7928:1875509845708288:0@lo:502: 00000100:00100000:1.0:1788625687.550399:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.550846:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.550908:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708288 00000100:00100000:3.0:1788625687.550915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708288 00000100:00100000:3.0:1788625687.551144:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788625687.551155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7928:x1875509845708288:12345-0@lo:502: 00000100:00100000:3.0:1788625687.551464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7928:x1875509845708288:12345-0@lo:502: Request processed in 295us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.551473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625687.551658:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7928:1875509845708288:0@lo:502: 00000100:00100000:1.0:1788625687.551716:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7928:1875509845708416:0@lo:502: 00000100:00100000:1.0:1788625687.551853:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.551876:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.551926:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708416 00000100:00100000:0.0:1788625687.551930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708416 00000100:00100000:0.0:1788625687.551955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625687.551963:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7928:x1875509845708416:12345-0@lo:502: 00000100:00100000:0.0:1788625687.552109:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:7928:x1875509845708416:12345-0@lo:502: Request processed in 147us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.552115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788625687.553118:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7928:1875509845708416:0@lo:502: 00000040:00080000:1.0:1788625687.553148:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788625687.553301:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788625687.553324:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625687.553334:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625687.553345:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625687.553355:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788625687.553358:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788625687.553360:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625687.553388:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625687.553396:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625687.553418:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625687.553435:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708544:0@lo:101: 00000100:00100000:3.0:1788625687.553684:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.553770:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43555ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.553872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708544 00000100:00100000:0.0:1788625687.553884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708544 00000100:00100000:0.0:1788625687.553950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625687.553960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845708544:12345-0@lo:101: 00010000:00010000:0.0:1788625687.553972:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625687.553985:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13623 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.554007:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13623 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.554018:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13623 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.554028:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340030a00, rc 0) 00000100:00100000:0.0:1788625687.554102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845708544:12345-0@lo:101: Request processed in 143us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.554108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788625687.554172:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708544:0@lo:101: 00010000:00010000:1.0:1788625687.554186:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.554195:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625687.554239:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708672:0@lo:501: 00000100:00100000:1.0:1788625687.554267:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.554318:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.554349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708672 00000100:00100000:0.0:1788625687.554353:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708672 00000100:00100000:0.0:1788625687.554411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788625687.554418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845708672:12345-0@lo:501: 00000100:00100000:0.0:1788625687.554762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845708672:12345-0@lo:501: Request processed in 343us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.554769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788625687.554851:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708672:0@lo:501: 00000100:00100000:1.0:1788625687.554882:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708800:0@lo:503: 00000100:00100000:1.0:1788625687.554918:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.554939:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708800 00000100:00100000:1.0:1788625687.554943:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708800 00000100:00100000:1.0:1788625687.554964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788625687.554972:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845708800:12345-0@lo:503: 00000100:00100000:1.0:1788625687.555623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845708800:12345-0@lo:503: Request processed in 651us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.555631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788625687.555671:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.555685:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845708800:0@lo:503: 00000100:00100000:1.0:1788625687.555868:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7929:1875509845708928:0@lo:502: 00000100:00100000:1.0:1788625687.555912:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.555933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845708928 00000100:00100000:1.0:1788625687.555937:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845708928 00000100:00100000:1.0:1788625687.555958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788625687.555966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:7929:x1875509845708928:12345-0@lo:502: 00000100:00100000:1.0:1788625687.556125:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:7929:x1875509845708928:12345-0@lo:502: Request processed in 160us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.556132:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788625687.556160:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.556174:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7929:1875509845708928:0@lo:502: 00000020:01000000:1.0:1788625687.556197:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625687.556206:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625687.556208:0:7929:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625687.556212:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625687.556214:0:7929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788625687.556227:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7929:1875509845709056:0@lo:502: 00000100:00100000:1.0:1788625687.556256:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.556278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709056 00000100:00100000:1.0:1788625687.556281:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709056 00000100:00100000:1.0:1788625687.556299:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625687.556305:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:7929:x1875509845709056:12345-0@lo:502: 00000100:00100000:1.0:1788625687.556418:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:7929:x1875509845709056:12345-0@lo:502: Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.556425:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625687.556692:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.556708:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7929:1875509845709056:0@lo:502: 00000020:01000000:1.0:1788625687.556830:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625687.556840:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625687.556842:0:7929:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788625687.556846:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788625687.560601:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788625687.560638:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788625687.560651:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.560664:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625687.560673:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788625687.560676:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4346652800 from 30 10000000:01000000:2.0:1788625687.560679:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625687.560716:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.560725:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.560749:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.560771:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709184:0@lo:101: 00000100:00100000:2.0:1788625687.560836:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.560881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709184 00000100:00100000:2.0:1788625687.560888:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709184 00000100:00100000:2.0:1788625687.560927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625687.560936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845709184:12345-0@lo:101: 00010000:00010000:2.0:1788625687.560960:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625687.560972:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13631 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.560995:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13631 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.561006:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13631 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.561015:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017200, rc 0) 00000100:00100000:2.0:1788625687.561046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709184:12345-0@lo:101: Request processed in 111us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.561054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625687.561096:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.561117:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709184:0@lo:101: 00010000:00010000:2.0:1788625687.561131:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.561141:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.561186:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709312:0@lo:501: 00000100:00100000:2.0:1788625687.561206:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.561224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709312 00000100:00100000:2.0:1788625687.561227:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709312 00000100:00100000:2.0:1788625687.561248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625687.561254:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709312:12345-0@lo:501: 00000100:00100000:2.0:1788625687.564593:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709312:12345-0@lo:501: Request processed in 3331us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.564605:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625687.565805:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.565840:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709312:0@lo:501: 00000100:00100000:2.0:1788625687.565895:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709440:0@lo:503: 00000100:00100000:2.0:1788625687.565949:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.565983:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.565993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709440 00000100:00100000:1.0:1788625687.566001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709440 00000100:00100000:1.0:1788625687.566057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788625687.566069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709440:12345-0@lo:503: 00000100:00100000:1.0:1788625687.566513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709440:12345-0@lo:503: Request processed in 446us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.566523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788625687.567432:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709440:0@lo:503: 00000100:00100000:1.0:1788625687.568637:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7932:1875509845709568:0@lo:502: 00000100:00100000:1.0:1788625687.568692:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.568750:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.568907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709568 00000100:00100000:2.0:1788625687.568915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709568 00000100:00100000:2.0:1788625687.568957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788625687.568966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:7932:x1875509845709568:12345-0@lo:502: 00000100:00100000:2.0:1788625687.569488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:7932:x1875509845709568:12345-0@lo:502: Request processed in 521us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.569496:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788625687.569499:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7932:1875509845709568:0@lo:502: 00000100:00100000:1.0:1788625687.569543:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7932:1875509845709696:0@lo:502: 00000100:00100000:1.0:1788625687.569581:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.569602:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.569851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709696 00000100:00100000:2.0:1788625687.569856:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709696 00000100:00100000:2.0:1788625687.569891:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625687.569897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:7932:x1875509845709696:12345-0@lo:502: 00000100:00100000:2.0:1788625687.570046:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:7932:x1875509845709696:12345-0@lo:502: Request processed in 147us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.570052:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788625687.570153:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7932:1875509845709696:0@lo:502: 00000040:00080000:1.0:1788625687.570168:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788625687.570440:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788625687.570454:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625687.570471:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.570492:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625687.570502:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625687.570505:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b4346652800 from 5 10000000:01000000:2.0:1788625687.570508:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625687.570534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.570543:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.570552:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.570565:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709824:0@lo:101: 00000100:00100000:2.0:1788625687.570591:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.570611:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709824 00000100:00100000:2.0:1788625687.570614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709824 00000100:00100000:2.0:1788625687.570999:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625687.571007:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845709824:12345-0@lo:101: 00010000:00010000:2.0:1788625687.571016:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625687.571027:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371017a00/0x8aede7274cb13646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1363f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571049:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371017a00/0x8aede7274cb13646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1363f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571059:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371017a00/0x8aede7274cb13646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1363f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571075:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017a00, rc 0) 00000100:00100000:2.0:1788625687.571102:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845709824:12345-0@lo:101: Request processed in 96us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.571108:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625687.571141:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.571155:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709824:0@lo:101: 00010000:00010000:2.0:1788625687.571168:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571177:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.571221:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709952:0@lo:256: 00000100:00100000:2.0:1788625687.571250:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.571276:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.571339:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845709952 00000100:00100000:1.0:1788625687.571345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845709952 00000100:00100000:1.0:1788625687.571372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788625687.571381:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845709952:12345-0@lo:256: 20000000:01000000:1.0:1788625687.571395:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625687.571411:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625687.571413:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788625687.571571:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845709952:12345-0@lo:256: Request processed in 191us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.571583:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788625687.571595:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845709952:0@lo:256: 10000000:01000000:2.0:1788625687.571638:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625687.571644:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571653:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625687.571660:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788625687.571662:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788625687.571665:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788625687.571684:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571691:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571699:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.571710:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710080:0@lo:101: 00000100:00100000:2.0:1788625687.571770:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.571794:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.571826:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710080 00000100:00100000:0.0:1788625687.571831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710080 00000100:00100000:0.0:1788625687.571858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788625687.571865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845710080:12345-0@lo:101: 00010000:00010000:0.0:1788625687.571872:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625687.571888:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1364d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.571904:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.571913:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625687.571919:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340030600, rc 0) 00000100:00100000:0.0:1788625687.571952:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710080:12345-0@lo:101: Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.571959:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625687.571978:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710080:0@lo:101: 00010000:00010000:2.0:1788625687.571990:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.571999:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.572036:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710208:0@lo:501: 00000100:00100000:2.0:1788625687.572058:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.572079:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.572278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710208 00000100:00100000:0.0:1788625687.572283:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710208 00000100:00100000:0.0:1788625687.572307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788625687.572314:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710208:12345-0@lo:501: 00000100:00100000:0.0:1788625687.572641:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710208:12345-0@lo:501: Request processed in 327us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.572648:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625687.575897:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710208:0@lo:501: 00000100:00100000:2.0:1788625687.575962:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710336:0@lo:503: 00000100:00100000:2.0:1788625687.576033:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.576078:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710336 00000100:00100000:2.0:1788625687.576085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710336 00000100:00100000:2.0:1788625687.576141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625687.576158:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710336:12345-0@lo:503: 00000100:00100000:2.0:1788625687.576678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710336:12345-0@lo:503: Request processed in 520us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.576688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625687.576797:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.576818:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710336:0@lo:503: 00000100:00100000:1.0:1788625687.578869:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7933:1875509845710464:0@lo:502: 00000100:00100000:1.0:1788625687.578937:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625687.578969:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435202ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625687.579024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710464 00000100:00100000:0.0:1788625687.579031:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710464 00000100:00100000:0.0:1788625687.579074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625687.579083:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:7933:x1875509845710464:12345-0@lo:502: 00000100:00100000:0.0:1788625687.579639:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:7933:x1875509845710464:12345-0@lo:502: Request processed in 556us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625687.579648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788625687.579759:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7933:1875509845710464:0@lo:502: 00000020:01000000:1.0:1788625687.579786:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625687.579793:0:7933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788625687.579800:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625687.579803:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788625687.579807:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788625687.579811:0:7933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1788625687.579833:0:7933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788625687.579836:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625687.579851:0:7933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b43797899c0) 00000020:00000080:1.0:1788625687.579870:0:7933:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788625687.579875:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788625687.579943:0:7933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788625687.579949:0:7933:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788625687.579956:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb13662 00010000:00080000:1.0:1788625687.579982:0:7933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b4378fb2000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1788625687.580201:0:7933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788625687.582675:0:7933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788625687.582693:0:7933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788625687.583214:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625687.585024:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625687.585080:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788625687.585138:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788625687.587134:0:7934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625687.587142:0:7934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788625687.598990:0:7933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625687.599005:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625687.599043:0:7933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788625687.599075:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb13669 00000100:00080000:2.0:1788625687.599087:0:7933:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625687.599094:0:7933:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b4378fb2000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625687.599127:0:7933:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b434fcd1c00 x1875509845710592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625687.599190:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845710592:0@lo:8: 00000100:00100000:3.0:1788625687.599255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788625687.599327:0:7933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788625687.599389:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625687.599394:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625687.599396:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788625687.599399:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625687.599403:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625687.599405:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625687.599407:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625687.599409:0:7933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625687.599431:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7933:1875509845710720:0@lo:502: 00000100:00100000:1.0:1788625687.599555:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710592 00000100:00100000:1.0:1788625687.599563:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710592 00000100:00100000:1.0:1788625687.599596:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625687.599605:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875509845710592:12345-0@lo:8: 00010000:00080000:1.0:1788625687.599627:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1788625687.599651:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb13670 00002000:00100000:1.0:1788625687.599664:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b4378fb0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788625687.599669:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788625687.599673:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788625687.599817:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788625687.600003:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788625687.600026:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b4378fb2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625687.600087:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875509845710592:12345-0@lo:8: Request processed in 482us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.600095:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625687.600573:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.600600:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.600619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710720 00000100:00100000:2.0:1788625687.600624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710720 00000100:00100000:2.0:1788625687.600659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788625687.600666:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:7933:x1875509845710720:12345-0@lo:502: 00000100:00100000:2.0:1788625687.600893:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:7933:x1875509845710720:12345-0@lo:502: Request processed in 226us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625687.600900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788625687.600952:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:7933:1875509845710720:0@lo:502: 00000020:01000000:2.0:1788625687.600980:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625687.600985:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625687.600987:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625687.600990:0:7933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788625687.601099:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788625687.601117:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625687.601125:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.601136:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625687.601147:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788625687.601149:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b4346390000 from 1 10000000:01000000:2.0:1788625687.601152:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788625687.601178:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.601188:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.601197:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.601223:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710848:0@lo:101: 00000100:00100000:2.0:1788625687.601252:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788625687.602382:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd1c00 x1875509845710592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625687.602394:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625687.602401:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788625687.602409:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788625687.602415:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788625687.602418:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4378fb2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788625687.602430:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788625687.602436:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845710592:0@lo:8: 00000004:00080000:1.0:1788625687.602470:0:7934:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788625687.602576:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237598847470ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788625687.602870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710848 00000100:00100000:1.0:1788625687.602877:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710848 00000100:00100000:2.0:1788625687.602893:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625687.602922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788625687.602933:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845710848:12345-0@lo:101: 00010000:00010000:1.0:1788625687.602944:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625687.602959:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13677 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.602984:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13677 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.603008:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13677 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625687.603017:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2600, rc 0) 00000100:00100000:1.0:1788625687.603066:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845710848:12345-0@lo:101: Request processed in 135us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625687.603072:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788625687.603345:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710848:0@lo:101: 00010000:00010000:2.0:1788625687.603362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.603373:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625687.603426:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710976:0@lo:501: 00000100:00100000:2.0:1788625687.604537:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625687.604570:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625687.604636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845710976 00000100:00100000:2.0:1788625687.604643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845710976 00000100:00100000:2.0:1788625687.604675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625687.604684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845710976:12345-0@lo:501: 00000100:00100000:2.0:1788625687.604895:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845710976:12345-0@lo:501: Request processed in 211us (359us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625687.604902:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625687.604940:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845710976:0@lo:501: 10000000:01000000:2.0:1788625687.604967:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788625687.604975:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625687.604985:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625687.650952:0:7935:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788625687.650984:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711232:0@lo:7: 00000100:00100000:3.0:1788625687.651048:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.651077:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43486cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.651096:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845711104:0@lo:13: 00000004:00080000:2.0:1788625687.651096:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788625687.651128:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.651171:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711232 00000100:00100000:3.0:1788625687.651177:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711232 00000100:00100000:3.0:1788625687.651245:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625687.651254:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1875509845711232:12345-0@lo:7: 00002000:00080000:3.0:1788625687.660337:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788625687.660345:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788625687.660439:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1875509845711232:12345-0@lo:7: Request processed in 9181us (9387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.660449:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788625687.660515:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718a80 x1875509845711232/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625687.660532:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711232:0@lo:7: 00000004:00080000:3.0:1788625687.660547:0:7935:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788625687.660587:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711360:0@lo:5: 00000100:00100000:3.0:1788625687.660617:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.660643:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43486cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.660666:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711104 00000100:00100000:3.0:1788625687.660673:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711104 00000100:00100000:3.0:1788625687.660715:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625687.660726:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845711104:12345-0@lo:13: 00002000:00000024:3.0:1788625687.660774:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788625687.660811:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845711104:12345-0@lo:13: Request processed in 87us (9683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.660817:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788625687.660835:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625687.660848:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711360 00000100:00100000:3.0:1788625687.660851:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711360 00000100:00100000:3.0:1788625687.660869:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625687.660876:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1875509845711360:12345-0@lo:5: 00002000:00080000:3.0:1788625687.660904:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788625687.660907:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788625687.661113:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7935:x1875509845711360:12345-0@lo:5: Request processed in 237us (495us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788625687.661120:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788625687.661153:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379719880 x1875509845711104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625687.661169:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845711104:0@lo:13: 00010000:00080000:3.0:1788625687.661193:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718a80 x1875509845711360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625687.661204:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711360:0@lo:5: 00000004:00080000:3.0:1788625687.661212:0:7935:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788625687.661237:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711488:0@lo:700: 00000100:00100000:3.0:1788625687.661383:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.661403:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43486cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.661418:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711488 00000100:00100000:3.0:1788625687.661422:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711488 00000100:00100000:3.0:1788625687.661446:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625687.661452:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7935:x1875509845711488:12345-0@lo:700: 00000100:00100000:3.0:1788625687.661489:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1875509845711616:0@lo:700: 00000100:00100000:3.0:1788625687.661529:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625687.661550:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43486cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.661570:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711616 00000100:00100000:3.0:1788625687.661573:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711616 00000100:00100000:3.0:1788625687.661602:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625687.661609:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1875509845711616:12345-0@lo:700: 40000000:02000000:3.0:1788625687.696927:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788625687.702510:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1875509845711616:12345-0@lo:700: Request processed in 40894us (40973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.702525:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625687.704047:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379718e00 x1875509845711616/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788625703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625687.704065:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1875509845711616:0@lo:700: 40000000:02000000:1.0:1788625687.704079:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1788625687.786165:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788625687.786186:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788625687.786526:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7935:x1875509845711488:12345-0@lo:700: Request processed in 125069us (125138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625687.786537:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625687.786613:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379719880 x1875509845711488/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625703 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625687.786640:0:7935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788625687.786656:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711488:0@lo:700: 00010000:00010000:0.0:1788625687.797936:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1788625687.821968:0:7935:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788625687.824907:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711744:0@lo:5: 00000100:00100000:0.0:1788625687.824972:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625687.825029:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625687.825089:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711744 00000100:00100000:3.0:1788625687.825096:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711744 00000100:00100000:3.0:1788625687.825151:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625687.825160:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7935:x1875509845711744:12345-0@lo:5: 00002000:00080000:3.0:1788625687.829405:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788625687.829425:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788625687.832795:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1875509845711744:12345-0@lo:5: Request processed in 7629us (7814us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788625687.832809:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788625687.832918:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea09180 x1875509845711744/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625703 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625687.832934:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875509845711744:0@lo:5: 00000004:00080000:0.0:1788625687.832948:0:7935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788625688.828886:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625689.201241:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788625689.842887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625690.866979:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625691.122958:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625691.122985:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845711872:0@lo:13: 00000100:00100000:0.0:1788625691.123098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625691.123164:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845711872 00000100:00100000:0.0:1788625691.123172:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845711872 00000100:00100000:0.0:1788625691.123240:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625691.123250:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845711872:12345-0@lo:13: 00002000:00000024:0.0:1788625691.123283:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625691.123329:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845711872:12345-0@lo:13: Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625691.123336:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788625691.123363:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625691.123405:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea08700 x1875509845711872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625691.123442:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845711872:0@lo:13: 00010000:00010000:2.0:1788625691.891088:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625692.662396:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625692.665231:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845712256:0@lo:400: 00000100:00100000:1.0:1788625692.665309:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625692.669013:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625692.669047:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845712384:0@lo:400: 00000100:00100000:0.0:1788625692.669142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625692.669234:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712384 00000100:00100000:0.0:1788625692.669242:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712384 00000100:00100000:0.0:1788625692.669296:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625692.669305:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845712384:12345-0@lo:400: 00000100:00100000:3.0:1788625692.670383:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845712000:0@lo:400: 00000100:00100000:3.0:1788625692.670442:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625692.670971:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845712384:12345-0@lo:400: Request processed in 1665us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625692.670984:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788625692.671051:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd2a00 x1875509845712384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625692.671065:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845712384:0@lo:400: 00000100:00100000:0.0:1788625692.671110:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845712128:0@lo:400: 00000100:00100000:0.0:1788625692.671149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625692.672240:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712000 00000100:00100000:1.0:1788625692.672264:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712000 00000100:00100000:1.0:1788625692.672321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788625692.672331:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845712000:12345-0@lo:400: 00000100:00100000:1.0:1788625692.672413:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845712000:12345-0@lo:400: Request processed in 83us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625692.672420:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788625692.673347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712256 00000100:00100000:1.0:1788625692.673355:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712256 00000100:00100000:1.0:1788625692.673464:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712128 00000100:00100000:1.0:1788625692.673468:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712128 00000100:00100000:1.0:1788625692.673489:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625692.673497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845712256:12345-0@lo:400: 00000100:00100000:1.0:1788625692.673552:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845712256:12345-0@lo:400: Request processed in 56us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625692.673558:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625692.673570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625692.673576:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845712128:12345-0@lo:400: 00000100:00080000:0.0:1788625692.675031:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788625692.675156:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd3480 x1875509845712128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625692.675172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845712128:0@lo:400: 00000100:00100000:1.0:1788625692.675500:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845712128:12345-0@lo:400: Request processed in 1921us (4348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625692.675510:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788625692.675560:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd0a80 x1875509845712256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625692.675571:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845712256:0@lo:400: 00000100:00100000:3.0:1788625692.677432:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845712000:0@lo:400: 00000100:00100000:3.0:1788625692.677528:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625692.677538:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875509845712512:0@lo:400: 00000100:00100000:3.0:1788625692.677618:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625692.678180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712512 00000100:00100000:3.0:1788625692.678190:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712512 00000100:00100000:3.0:1788625692.678252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625692.678262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875509845712512:12345-0@lo:400: 00000100:00100000:3.0:1788625692.678328:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875509845712512:12345-0@lo:400: Request processed in 67us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625692.678336:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788625692.678359:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625692.678411:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b42436d5f80 x1875509845712512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625692.678424:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875509845712512:0@lo:400: 00000100:00100000:3.0:1788625692.678516:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845712640:0@lo:400: 00000100:00100000:3.0:1788625692.678549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625692.678587:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712640 00000100:00100000:3.0:1788625692.678591:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712640 00000100:00100000:3.0:1788625692.678624:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625692.678632:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845712640:12345-0@lo:400: 00000100:00100000:3.0:1788625692.680427:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845712640:12345-0@lo:400: Request processed in 1788us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625692.680440:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788625692.680472:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788625692.680506:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b42436d5f80 x1875509845712640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625692.680520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845712640:0@lo:400: 00010000:00010000:3.0:1788625692.916622:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625693.171346:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845712768:0@lo:13: 00000100:00100000:1.0:1788625693.171434:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625693.171551:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712768 00000100:00100000:2.0:1788625693.171560:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712768 00000100:00100000:2.0:1788625693.171613:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625693.171623:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845712768:12345-0@lo:13: 00002000:00000024:2.0:1788625693.171656:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625693.171704:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845712768:12345-0@lo:13: Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625693.171712:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788625693.171965:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea09880 x1875509845712768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625693.171986:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845712768:0@lo:13: 00000001:00080000:2.0:1788625693.266884:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788625693.938890:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625694.963784:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625695.986957:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625696.215571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.215680:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823668608 00000100:00100000:2.0:1788625696.215691:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823668608 00000100:00100000:2.0:1788625696.215769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:2.0:1788625696.215777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1875509823668608:12345-192.168.201.45@tcp:250: 00010000:00080000:2.0:1788625696.215805:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7e14f167-db63-45ad-afc4-5c2146b520f9@192.168.201.45@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788625696.215836:0:5836:0:(genops.c:1385:class_connect()) connect: client 7e14f167-db63-45ad-afc4-5c2146b520f9, cookie 0x8aede7274cb13685 00000100:00080000:2.0:1788625696.215994:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9b4241b5f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625696.216064:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+5:2362:x1875509823668608:12345-192.168.201.45@tcp:250: Request processed in 286us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.216070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1788625696.222244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.222420:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823668480 00000100:00100000:2.0:1788625696.222448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823668480 00000100:00100000:2.0:1788625696.222513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:2.0:1788625696.222524:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+5:5592:x1875509823668480:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1788625696.222541:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625696.222559:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca2f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625696.222589:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625696.222601:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625696.222611:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016e00, rc 0) 00000100:00100000:2.0:1788625696.222712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+6:5592:x1875509823668480:12345-192.168.201.45@tcp:101: Request processed in 190us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.222719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:3.0:1788625696.233760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.234047:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823668736 00000100:00100000:1.0:1788625696.234058:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823668736 00000100:00100000:1.0:1788625696.234147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:1.0:1788625696.234155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+6:5592:x1875509823668736:12345-192.168.201.45@tcp:501: 00000100:00100000:1.0:1788625696.234494:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+6:5592:x1875509823668736:12345-192.168.201.45@tcp:501: Request processed in 338us (770us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625696.234502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:2.0:1788625696.241860:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625696.241929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823668864 00000100:00100000:0.0:1788625696.241939:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823668864 00000100:00100000:0.0:1788625696.241988:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:0.0:1788625696.242011:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+6:5592:x1875509823668864:12345-192.168.201.45@tcp:101: 00010000:00010000:0.0:1788625696.242029:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625696.242047:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca36 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.242076:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.242088:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.242097:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031400, rc 0) 00000100:00100000:0.0:1788625696.242216:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+7:5592:x1875509823668864:12345-192.168.201.45@tcp:101: Request processed in 205us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625696.242224:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:0.0:1788625696.243257:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845712896:0@lo:13: 00000100:00100000:0.0:1788625696.243316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625696.243429:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845712896 00000100:00100000:3.0:1788625696.243435:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845712896 00000100:00100000:3.0:1788625696.243482:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625696.243499:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845712896:12345-0@lo:13: 00002000:00000024:3.0:1788625696.243528:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788625696.243621:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625696.243683:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845712896:12345-0@lo:13: Request processed in 185us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625696.243691:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788625696.243767:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b42436d5f80 x1875509845712896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625696.243787:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845712896:0@lo:13: 00000100:00100000:3.0:1788625696.245354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.245570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823668992 00000100:00100000:1.0:1788625696.245579:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823668992 00000100:00100000:1.0:1788625696.245627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:1.0:1788625696.245636:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+7:5592:x1875509823668992:12345-192.168.201.45@tcp:501: 00000100:00100000:1.0:1788625696.245933:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5592:x1875509823668992:12345-192.168.201.45@tcp:501: Request processed in 298us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625696.245941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:3.0:1788625696.248232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.248884:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669120 00000100:00100000:2.0:1788625696.248898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669120 00000100:00100000:2.0:1788625696.248959:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:2.0:1788625696.248970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5592:x1875509823669120:12345-192.168.201.45@tcp:503: 00000100:00100000:2.0:1788625696.249511:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5592:x1875509823669120:12345-192.168.201.45@tcp:503: Request processed in 541us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.249520:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:2.0:1788625696.256324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625696.256421:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669248 00000100:00100000:0.0:1788625696.256431:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669248 00000100:00100000:0.0:1788625696.256490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:0.0:1788625696.256500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5611:x1875509823669248:12345-192.168.201.45@tcp:502: 00000100:00100000:0.0:1788625696.257056:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5611:x1875509823669248:12345-192.168.201.45@tcp:502: Request processed in 555us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625696.257074:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1788625696.304918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.305084:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669376 00000100:00100000:1.0:1788625696.305094:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669376 00000100:00100000:1.0:1788625696.305161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:1.0:1788625696.305171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5611:x1875509823669376:12345-192.168.201.45@tcp:502: 00000100:00100000:1.0:1788625696.305459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5611:x1875509823669376:12345-192.168.201.45@tcp:502: Request processed in 288us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625696.305467:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:3.0:1788625696.308491:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625696.308873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669504 00000100:00100000:0.0:1788625696.308884:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669504 00000100:00100000:0.0:1788625696.308946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:0.0:1788625696.308956:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5592:x1875509823669504:12345-192.168.201.45@tcp:101: 00010000:00010000:0.0:1788625696.308973:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625696.308994:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031c00/0x8aede7274cb1369a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.309023:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031c00/0x8aede7274cb1369a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca60 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.309035:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031c00/0x8aede7274cb1369a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca60 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625696.309044:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031c00, rc 0) 00000100:00100000:0.0:1788625696.309112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5592:x1875509823669504:12345-192.168.201.45@tcp:101: Request processed in 149us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625696.309120:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:0.0:1788625696.320624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.322671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669632 00000100:00100000:2.0:1788625696.322686:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669632 00000100:00100000:2.0:1788625696.322839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1788625696.322851:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5592:x1875509823669632:12345-192.168.201.45@tcp:256: 20000000:01000000:2.0:1788625696.322880:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788625696.322898:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788625696.322902:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788625696.322905:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788625696.322907:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788625696.327646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5592:x1875509823669632:12345-192.168.201.45@tcp:256: Request processed in 4785us (7020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.327661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:3.0:1788625696.335050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.335156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669760 00000100:00100000:1.0:1788625696.335177:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669760 00000100:00100000:1.0:1788625696.335234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:1.0:1788625696.335243:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5592:x1875509823669760:12345-192.168.201.45@tcp:101: 00010000:00010000:1.0:1788625696.335259:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625696.335276:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca67 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625696.335315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625696.335343:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625696.335352:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3600, rc 0) 00000100:00100000:1.0:1788625696.335410:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5592:x1875509823669760:12345-192.168.201.45@tcp:101: Request processed in 168us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625696.335416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:3.0:1788625696.338831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.339057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823669888 00000100:00100000:2.0:1788625696.339068:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823669888 00000100:00100000:2.0:1788625696.339129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1788625696.339139:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5592:x1875509823669888:12345-192.168.201.45@tcp:501: 00000100:00100000:2.0:1788625696.339451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5592:x1875509823669888:12345-192.168.201.45@tcp:501: Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.339460:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:3.0:1788625696.346027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625696.346133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670016 00000100:00100000:0.0:1788625696.346144:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670016 00000100:00100000:0.0:1788625696.346214:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:0.0:1788625696.346225:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5592:x1875509823670016:12345-192.168.201.45@tcp:503: 00000100:00100000:0.0:1788625696.346666:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5592:x1875509823670016:12345-192.168.201.45@tcp:503: Request processed in 442us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625696.346674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:3.0:1788625696.355073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.355194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670144 00000100:00100000:1.0:1788625696.355206:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670144 00000100:00100000:1.0:1788625696.355268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:1.0:1788625696.355280:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5615:x1875509823670144:12345-192.168.201.45@tcp:502: 00000100:00100000:1.0:1788625696.355833:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5615:x1875509823670144:12345-192.168.201.45@tcp:502: Request processed in 553us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625696.355842:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:3.0:1788625696.358920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625696.359334:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670272 00000100:00100000:2.0:1788625696.359345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670272 00000100:00100000:2.0:1788625696.359401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:2.0:1788625696.359412:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5615:x1875509823670272:12345-192.168.201.45@tcp:502: 00000100:00100000:2.0:1788625696.359673:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5615:x1875509823670272:12345-192.168.201.45@tcp:502: Request processed in 261us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625696.359682:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:3.0:1788625696.367514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625696.374642:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670400 00000100:00100000:1.0:1788625696.374658:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670400 00000100:00100000:1.0:1788625696.374750:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1788625696.374760:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1875509823670400:12345-192.168.201.45@tcp:38: 00010000:00080000:1.0:1788625696.374833:0:6721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1788625696.374886:0:6721:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb136a8 00000004:00100000:1.0:1788625696.374918:0:6721:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788625696.374924:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788625696.442958:0:6721:0:(import.c:65:import_set_state_nolock()) ffff9b4379ee8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625696.443054:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823670400:12345-192.168.201.45@tcp:38: Request processed in 68292us (75548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625696.443081:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00010000:00010000:0.0:1788625697.011461:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625697.454676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625697.454889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625697.460615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670528 00000100:00100000:1.0:1788625697.460630:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670528 00000100:00100000:1.0:1788625697.460754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670656 00000100:00100000:1.0:1788625697.460758:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670656 00000100:00100000:1.0:1788625697.460788:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625697.460799:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:0:x1875509823670528:12345-192.168.201.45@tcp:41: 00000004:00000024:1.0:1788625697.460841:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788625697.460948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:0:x1875509823670528:12345-192.168.201.45@tcp:41: Request processed in 150us (6282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.460956:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625697.460988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625697.460996:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823670656:12345-192.168.201.45@tcp:41: 00000004:00000024:1.0:1788625697.461007:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788625697.461028:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823670656:12345-192.168.201.45@tcp:41: Request processed in 34us (6141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.461034:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:3.0:1788625697.466469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625697.470586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625697.471341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670784 00000100:00100000:1.0:1788625697.471352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670784 00000100:00100000:1.0:1788625697.471421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1788625697.471431:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823670784:12345-192.168.201.45@tcp:40: 00000100:00100000:1.0:1788625697.472584:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823670784:12345-192.168.201.45@tcp:40: Request processed in 1146us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.472594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1788625697.484467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625697.484509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625697.484695:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823670912 00000100:00100000:0.0:1788625697.484706:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823670912 00000100:00100000:0.0:1788625697.484772:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1788625697.484782:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875509823670912:12345-192.168.201.45@tcp:8: 00010000:00080000:0.0:1788625697.484813:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1788625697.484843:0:6697:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb136af 00002000:00100000:0.0:1788625697.484854:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b12515be-537a-4a8b-a2d2-568b1a5329ac/ffff9b434f8c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788625697.484865:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788625697.485639:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788625697.485671:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b434f8c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625697.485767:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823670912:12345-192.168.201.45@tcp:8: Request processed in 985us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625697.485775:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1788625697.486807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671168 00000100:00100000:3.0:1788625697.486818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671168 00000100:00100000:3.0:1788625697.486875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625697.486885:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823671168:12345-192.168.201.45@tcp:33: 00000100:00100000:2.0:1788625697.487077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625697.487123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625697.487339:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671040 00000100:00100000:3.0:1788625697.487344:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671040 00000100:00100000:3.0:1788625697.487378:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1788625697.487383:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875509823671040:12345-192.168.201.45@tcp:8: 00010000:00080000:3.0:1788625697.487405:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1788625697.487446:0:6698:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb136b6 00002000:00100000:3.0:1788625697.487456:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b12515be-537a-4a8b-a2d2-568b1a5329ac/ffff9b4350f98000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788625697.487478:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788625697.487798:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788625697.487824:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b4350f9e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625697.487876:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823671040:12345-192.168.201.45@tcp:8: Request processed in 491us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625697.487883:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625697.487966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671296 00000100:00100000:1.0:1788625697.487977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671296 00000100:00100000:1.0:1788625697.488015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:1.0:1788625697.488023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823671296:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625697.488052:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823671296:12345-192.168.201.45@tcp:400: Request processed in 31us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.488059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000004:00080000:3.0:1788625697.530819:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43874us 00000004:00200000:0.0:1788625697.569153:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788625697.569280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5592:x1875509823671168:12345-192.168.201.45@tcp:33: Request processed in 82391us (84765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625697.569304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1788625697.779047:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845713280:0@lo:400: 00000100:00100000:1.0:1788625697.779127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625697.779202:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625697.779209:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845713152:0@lo:400: 00000100:00100000:1.0:1788625697.779232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625697.779252:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845713664:0@lo:400: 00000100:00100000:1.0:1788625697.779291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625697.779328:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713280 00000100:00100000:1.0:1788625697.779335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713280 00000100:00100000:1.0:1788625697.779424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713152 00000100:00100000:1.0:1788625697.779429:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713152 00000100:00100000:1.0:1788625697.779451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625697.779459:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845713280:12345-0@lo:400: 00000100:00100000:1.0:1788625697.779507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845713280:12345-0@lo:400: Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.779514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625697.779530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625697.779536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845713152:12345-0@lo:400: 00000100:00100000:1.0:1788625697.779561:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845713152:12345-0@lo:400: Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.779566:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625697.779608:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713664 00000100:00100000:1.0:1788625697.779611:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713664 00000100:00100000:1.0:1788625697.779638:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625697.779645:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845713664:12345-0@lo:400: 00000100:00100000:1.0:1788625697.779673:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845713664:12345-0@lo:400: Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.779679:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788625697.779718:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3d880 x1875509845713152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625697.779757:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845713152:0@lo:400: 00010000:00080000:1.0:1788625697.779770:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3ce00 x1875509845713664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625697.779776:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788625697.779791:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845713664:0@lo:400: 00010000:00080000:1.0:1788625697.779800:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3e680 x1875509845713280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625697.779807:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845713280:0@lo:400: 00000100:00080000:3.0:1788625697.780014:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625697.780019:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625697.780082:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845713024:0@lo:400: 00000100:00100000:2.0:1788625697.780119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625697.780161:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845713536:0@lo:400: 00000100:00100000:2.0:1788625697.780187:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625697.780209:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625697.780215:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845713408:0@lo:400: 00000100:00100000:2.0:1788625697.780259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625697.780298:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713536 00000100:00100000:2.0:1788625697.780302:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713536 00000100:00100000:2.0:1788625697.780337:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625697.780344:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845713536:12345-0@lo:400: 00000100:00100000:2.0:1788625697.780379:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845713536:12345-0@lo:400: Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625697.780385:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788625697.780420:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3ed80 x1875509845713536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625697.780429:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845713536:0@lo:400: 00000100:00100000:2.0:1788625697.780450:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713408 00000100:00100000:2.0:1788625697.780454:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713408 00000100:00100000:2.0:1788625697.780475:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625697.780481:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845713408:12345-0@lo:400: 00000100:00100000:2.0:1788625697.780512:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845713408:12345-0@lo:400: Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625697.780517:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788625697.780552:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3d500 x1875509845713408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625697.780560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845713408:0@lo:400: 00000100:00100000:3.0:1788625697.780824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713024 00000100:00100000:3.0:1788625697.780829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713024 00000100:00100000:3.0:1788625697.780863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788625697.780870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845713024:12345-0@lo:400: 00000100:00100000:3.0:1788625697.780908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845713024:12345-0@lo:400: Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625697.780914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788625697.780948:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845713024:0@lo:400: 00000100:00080000:3.0:1788625697.780963:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625697.900586:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625697.900692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671424 00000100:00100000:1.0:1788625697.900702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671424 00000100:00100000:1.0:1788625697.900788:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1788625697.900800:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5632:x1875509823671424:12345-192.168.201.45@tcp:101: 00010000:00010000:1.0:1788625697.900820:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625697.900867:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb136bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca91 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.900941:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.900962:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.900977:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625697.901013:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788625697.901016:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625697.901032:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.901056:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb136bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca91 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.901075:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca91 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625697.901083:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f800) 00010000:00010000:1.0:1788625697.901086:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625697.901089:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2000, rc 0) 00000100:00100000:1.0:1788625697.901375:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:5632:x1875509823671424:12345-192.168.201.45@tcp:101: Request processed in 577us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625697.901382:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00010000:00010000:2.0:1788625698.034969:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625698.291301:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625698.295320:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845713792:0@lo:13: 00000100:00100000:3.0:1788625698.295399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625698.298775:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713792 00000100:00100000:2.0:1788625698.298792:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713792 00000100:00100000:2.0:1788625698.298932:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625698.298943:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845713792:12345-0@lo:13: 00002000:00000024:2.0:1788625698.298980:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625698.299093:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845713792:12345-0@lo:13: Request processed in 151us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625698.299100:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788625698.299300:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea09180 x1875509845713792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625698.299320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845713792:0@lo:13: 00010000:00010000:3.0:1788625699.058973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625700.082910:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625700.580856:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625700.580950:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671552 00000100:00100000:2.0:1788625700.580959:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671552 00000100:00100000:2.0:1788625700.581034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625700.581053:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:5685:x1875509823671552:12345-192.168.201.45@tcp:41: 00000004:00000024:2.0:1788625700.581095:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788625700.581180:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:5685:x1875509823671552:12345-192.168.201.45@tcp:41: Request processed in 129us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625700.581187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00080000:3.0:1788625700.581383:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625700.589394:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625700.589576:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671680 00000100:00100000:1.0:1788625700.589586:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671680 00000100:00100000:1.0:1788625700.589665:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1788625700.589675:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5685:x1875509823671680:12345-192.168.201.45@tcp:13: 00002000:00000024:1.0:1788625700.589714:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625700.589805:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5685:x1875509823671680:12345-192.168.201.45@tcp:13: Request processed in 132us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625700.589812:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00080000:3.0:1788625700.590004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625700.598093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625700.598268:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671808 00000100:00100000:1.0:1788625700.598279:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671808 00000100:00100000:1.0:1788625700.598364:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625700.598375:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5685:x1875509823671808:12345-192.168.201.45@tcp:13: 00002000:00000024:1.0:1788625700.598423:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625700.598496:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:5685:x1875509823671808:12345-192.168.201.45@tcp:13: Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625700.598503:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00080000:3.0:1788625700.598672:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788625700.959348:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000001:00100000:2.0:1788625700.962314:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00010000:00010000:2.0:1788625701.107605:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625701.370395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845713920:0@lo:13: 00000100:00100000:3.0:1788625701.370473:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625701.370555:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845713920 00000100:00100000:3.0:1788625701.370564:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845713920 00000100:00100000:3.0:1788625701.370621:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625701.370631:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845713920:12345-0@lo:13: 00002000:00000024:3.0:1788625701.370658:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625701.370706:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845713920:12345-0@lo:13: Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625701.370713:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788625701.370757:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625701.370787:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b42436d6d80 x1875509845713920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625701.370809:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845713920:0@lo:13: 00000001:00100000:1.0:1788625701.942697:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00010000:00010000:3.0:1788625702.132466:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625702.558060:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625702.558106:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625702.558214:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625702.558253:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625702.558329:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672064 00000100:00100000:2.0:1788625702.558341:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672064 00000100:00100000:2.0:1788625702.558537:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1788625702.558551:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823672064:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1788625702.558638:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823672064:12345-192.168.201.45@tcp:400: Request processed in 91us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625702.558645:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00080000:2.0:1788625702.558669:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625702.561541:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823671936 00000100:00100000:0.0:1788625702.561557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823671936 00000100:00100000:0.0:1788625702.561632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:0.0:1788625702.561643:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823671936:12345-192.168.201.45@tcp:400: 00000100:00100000:0.0:1788625702.561720:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823671936:12345-192.168.201.45@tcp:400: Request processed in 79us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625702.561774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1788625702.573089:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672192 00000100:00100000:1.0:1788625702.573105:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672192 00000100:00100000:1.0:1788625702.573211:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672320 00000100:00100000:1.0:1788625702.573216:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672320 00000100:00100000:1.0:1788625702.573241:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625702.573252:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823672192:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625702.573345:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823672192:12345-192.168.201.45@tcp:400: Request processed in 85us (15229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.573354:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625702.573377:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1788625702.573384:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823672320:12345-192.168.201.45@tcp:400: 00000100:00080000:3.0:1788625702.573920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625702.573938:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625702.574091:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823672320:12345-192.168.201.45@tcp:400: Request processed in 705us (15835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.574100:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1788625702.903206:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845714048:0@lo:400: 00000100:00100000:3.0:1788625702.903284:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625702.903405:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714048 00000100:00100000:1.0:1788625702.903415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714048 00000100:00100000:1.0:1788625702.903467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788625702.903477:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845714048:12345-0@lo:400: 00000100:00100000:1.0:1788625702.907187:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845714048:12345-0@lo:400: Request processed in 3702us (3893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.907211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788625702.907285:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845714304:0@lo:400: 00000100:00100000:1.0:1788625702.907338:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625702.907393:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625702.907401:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845714176:0@lo:400: 00000100:00100000:1.0:1788625702.907427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625702.907459:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714304 00000100:00100000:1.0:1788625702.907467:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714304 00000100:00100000:1.0:1788625702.907513:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714176 00000100:00100000:1.0:1788625702.907517:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714176 00000100:00100000:1.0:1788625702.907535:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625702.907542:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845714304:12345-0@lo:400: 00000100:00100000:1.0:1788625702.907589:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845714304:12345-0@lo:400: Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.907596:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625702.907609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625702.907614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845714176:12345-0@lo:400: 00000100:00100000:1.0:1788625702.907639:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845714176:12345-0@lo:400: Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.907644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788625702.907670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625702.907710:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845714176:0@lo:400: 00000100:00100000:1.0:1788625702.907722:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845714304:0@lo:400: 00000100:00100000:1.0:1788625702.907795:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845714432:0@lo:400: 00000100:00100000:1.0:1788625702.907825:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625702.907858:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714432 00000100:00100000:1.0:1788625702.907862:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714432 00000100:00100000:1.0:1788625702.907886:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625702.907892:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845714432:12345-0@lo:400: 00000100:00100000:1.0:1788625702.907924:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845714432:12345-0@lo:400: Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.907929:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788625702.907967:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e0a80 x1875509845714432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625702.907978:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845714432:0@lo:400: 00000100:00100000:3.0:1788625702.912138:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845714048:0@lo:400: 00000100:00100000:3.0:1788625702.913071:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845714560:0@lo:400: 00000100:00100000:3.0:1788625702.913138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625702.913243:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845714688:0@lo:400: 00000100:00100000:2.0:1788625702.913279:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625702.913326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714688 00000100:00100000:2.0:1788625702.913334:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714688 00000100:00100000:2.0:1788625702.913405:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625702.913415:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845714688:12345-0@lo:400: 00000100:00100000:2.0:1788625702.913468:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845714688:12345-0@lo:400: Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625702.913475:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788625702.913510:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e0380 x1875509845714688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625702.913522:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845714688:0@lo:400: 00000100:00080000:2.0:1788625702.913542:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625702.917592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714560 00000100:00100000:1.0:1788625702.917609:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714560 00000100:00100000:1.0:1788625702.919168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625702.919182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845714560:12345-0@lo:400: 00000100:00100000:1.0:1788625702.919292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845714560:12345-0@lo:400: Request processed in 114us (6154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625702.919300:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625702.919602:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845714560:0@lo:400: 00000100:00080000:3.0:1788625702.922330:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625703.154891:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625703.418981:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845714816:0@lo:13: 00000100:00100000:2.0:1788625703.419061:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625703.421063:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714816 00000100:00100000:3.0:1788625703.421076:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714816 00000100:00100000:1.0:1788625703.421505:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625703.421517:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845714816:12345-0@lo:13: 00002000:00000024:1.0:1788625703.421556:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625703.421671:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845714816:12345-0@lo:13: Request processed in 156us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625703.421691:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788625703.423957:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b436ea09180 x1875509845714816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625703.423986:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845714816:0@lo:13: 00000001:02000400:3.0:1788625703.757715:0:8309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788625704.179754:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625705.204338:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625706.226851:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625706.485633:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845714944:0@lo:13: 00000100:00100000:2.0:1788625706.485755:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625706.486030:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845714944 00000100:00100000:1.0:1788625706.486039:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845714944 00000100:00100000:1.0:1788625706.486149:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625706.486800:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845714944:12345-0@lo:13: 00002000:00000024:1.0:1788625706.486842:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625706.486905:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845714944:12345-0@lo:13: Request processed in 112us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625706.486912:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788625706.487038:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e0380 x1875509845714944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625706.487061:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845714944:0@lo:13: 00000100:00080000:2.0:1788625706.487813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788625707.250881:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625707.670561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625707.670608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625707.670708:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672704 00000100:00100000:1.0:1788625707.670719:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672704 00000100:00100000:1.0:1788625707.670830:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625707.670842:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823672704:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625707.670925:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823672704:12345-192.168.201.45@tcp:400: Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625707.670932:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1788625707.671481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672448 00000100:00100000:2.0:1788625707.671489:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672448 00000100:00100000:2.0:1788625707.671556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:2.0:1788625707.671565:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823672448:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1788625707.671612:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823672448:12345-192.168.201.45@tcp:400: Request processed in 49us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625707.671619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00080000:3.0:1788625707.671779:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625707.675272:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625707.675318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625707.675400:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672576 00000100:00100000:1.0:1788625707.675410:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672576 00000100:00100000:1.0:1788625707.675493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:1.0:1788625707.675506:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823672576:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625707.675592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823672576:12345-192.168.201.45@tcp:400: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625707.675615:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00080000:3.0:1788625707.676114:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625707.676313:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672832 00000100:00100000:2.0:1788625707.676320:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672832 00000100:00100000:2.0:1788625707.676404:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625707.676414:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823672832:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1788625707.676466:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823672832:12345-192.168.201.45@tcp:400: Request processed in 53us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625707.676473:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00080000:3.0:1788625707.676944:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788625707.900393:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc043d2f40 20000000:00000080:3.0:1788625707.900414:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b4379ca4c00 uarg=0000000000000000 20000000:01000000:3.0:1788625707.900450:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788625707.900453:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788625707.900456:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788625707.900460:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788625707.900465:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788625707.900481:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788625707.900483:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788625707.900689:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788625707.900693:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788625707.902375:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788625707.904663:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788625707.904803:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788625707.904845:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788625707.904862:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788625707.904865:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788625707.907297:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788625707.909894:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788625707.909975:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788625707.910018:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788625707.910034:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788625707.910036:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788625707.918300:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788625707.919120:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788625707.919198:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788625707.919236:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788625707.919252:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788625707.919255:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788625707.921666:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788625707.923225:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788625707.923286:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788625707.923343:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1788625707.923369:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788625707.923398:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923421:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923430:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923438:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13615 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923445:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13623 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923451:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13631 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923458:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923482:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13677 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923492:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923498:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923506:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923619:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.923635:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 9 pid: 5836 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.923650:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715072:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625707.924260:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.924271:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.924281:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715200:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625707.924320:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.924338:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.924350:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379deed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715328:0@lo:104: 00000100:00100000:0.0:1788625707.924389:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625707.924475:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.924482:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.924490:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715456:0@lo:104: 00000100:00100000:0.0:1788625707.924511:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625707.925281:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.925293:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 18 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.925303:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715584:0@lo:104: 00010000:00010000:0.0:1788625707.925334:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.925342:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.925351:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715712:0@lo:104: 00010000:00010000:0.0:1788625707.925376:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.925393:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.925402:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715840:0@lo:104: 00010000:00010000:0.0:1788625707.925431:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.925440:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 18 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.925446:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715968:0@lo:104: 00010000:00010000:0.0:1788625707.925468:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.925476:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.925483:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845716096:0@lo:104: 00000100:00100000:0.0:1788625707.925504:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625707.925606:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788625707.925628:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625707.930476:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.931944:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715328 00000100:00100000:3.0:1788625707.931958:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715328 00000100:00100000:3.0:1788625707.932139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715456 00000100:00100000:3.0:1788625707.932144:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715456 00000100:00100000:3.0:1788625707.932160:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715584 00000100:00100000:3.0:1788625707.932163:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715584 00000100:00100000:3.0:1788625707.932178:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625707.932188:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8457:x1875509845715328:12345-0@lo:104: 00010000:00010000:3.0:1788625707.932208:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932299:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625707.932306:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8457:x1875509845715328:12345-0@lo:104: Request processed in 120us (7916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.932314:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625707.932335:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625707.932356:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379919450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845715456:12345-0@lo:104: 00010000:00010000:3.0:1788625707.932365:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932403:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625707.932424:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379919450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845715456:12345-0@lo:104: Request processed in 69us (7911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.932430:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625707.932468:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625707.932474:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8457:x1875509845715584:12345-0@lo:104: 00010000:00010000:3.0:1788625707.932483:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932517:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788625707.932522:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8457:x1875509845715584:12345-0@lo:104: Request processed in 49us (6894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.932528:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788625707.932553:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625707.932559:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932566:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625707.932570:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932579:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625707.932586:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625707.932592:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625707.932625:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932640:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625707.932659:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932666:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1367e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932680:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625707.932683:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932688:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017600 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625707.932692:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932698:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625707.932721:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625707.932749:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625707.932765:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932770:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625707.932783:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932789:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371017600/0x8aede7274cb1364d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13654 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932806:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625707.932808:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932813:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625707.932816:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932822:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625707.932828:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625707.932832:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625707.932846:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932852:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625707.932857:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932863:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371016c00/0x8aede7274cb13631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13638 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.932873:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.932874:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.932876:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.932882:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.932891:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625707.932905:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625707.932922:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716224:0@lo:103: 00000100:00100000:3.0:1788625707.932960:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.933008:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716224 00000100:00100000:3.0:1788625707.933013:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716224 00010000:00010000:3.0:1788625707.933036:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 19 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.933060:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625707.933066:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845716224:12345-0@lo:103: 00010000:00010000:3.0:1788625707.933075:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.933080:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 19 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.933090:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 19 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.933120:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.933148:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845716224:12345-0@lo:103: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.933154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625707.933186:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716224:0@lo:103: 00000100:00100000:0.0:1788625707.933338:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715072:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625707.933347:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715200:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625707.933356:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2600/0x8aede7274cb1367e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13677 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.933368:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379deed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715328:0@lo:104: 00000100:00100000:0.0:1788625707.933376:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715456:0@lo:104: 00000100:00100000:0.0:1788625707.933396:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715584:0@lo:104: 00000100:00100000:3.0:1788625707.935981:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716352:0@lo:103: 00000100:00100000:3.0:1788625707.936053:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.936119:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625707.936126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716480:0@lo:103: 00000100:00100000:3.0:1788625707.936150:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.936202:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716352 00000100:00100000:3.0:1788625707.936209:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716352 00010000:00010000:3.0:1788625707.936242:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 18 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.936270:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716480 00000100:00100000:3.0:1788625707.936273:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716480 00010000:00010000:3.0:1788625707.936285:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 19 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.936304:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625707.936312:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845716352:12345-0@lo:103: 00010000:00010000:3.0:1788625707.936325:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.936330:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 19 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936350:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 19 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936369:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340030600/0x8aede7274cb13654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1364d expref: 19 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936386:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.936421:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3308:x1875509845716352:12345-0@lo:103: Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.936428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625707.936445:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625707.936451:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3308:x1875509845716480:12345-0@lo:103: 00010000:00010000:3.0:1788625707.936460:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.936464:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 17 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936479:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 17 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936489:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371017200/0x8aede7274cb13638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13631 expref: 17 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.936499:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.936644:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845716480:12345-0@lo:103: Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.936651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625707.936690:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716480:0@lo:103: 00000100:00100000:3.0:1788625707.936786:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716352:0@lo:103: 00000100:00100000:2.0:1788625707.937134:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625707.937187:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.937208:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715712 00000100:00100000:3.0:1788625707.937213:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715712 00000100:00100000:3.0:1788625707.937237:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715840 00000100:00100000:3.0:1788625707.937240:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715840 00000100:00100000:3.0:1788625707.937253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625707.937260:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845715712:12345-0@lo:104: 00010000:00010000:3.0:1788625707.937274:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.937436:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625707.937443:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845715712:12345-0@lo:104: Request processed in 184us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.937449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625707.937464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625707.937470:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8457:x1875509845715840:12345-0@lo:104: 00010000:00010000:3.0:1788625707.937485:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625707.937552:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625707.937570:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788625707.937577:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788625707.937699:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845715968 00000100:00100000:2.0:1788625707.937714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845715968 00000100:00100000:2.0:1788625707.937757:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788625707.937765:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716096 00000100:00100000:2.0:1788625707.937768:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716096 00000100:00100000:2.0:1788625707.937831:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625707.937838:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8457:x1875509845715968:12345-0@lo:104: 00010000:00010000:2.0:1788625707.937846:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625707.938067:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715712:0@lo:104: 00000100:00100000:0.0:1788625707.938076:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715840:0@lo:104: 00000100:00100000:0.0:1788625707.938081:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845715968:0@lo:104: 00010000:00010000:1.0:1788625707.938135:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788625707.938143:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938149:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625707.938153:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938161:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625707.938168:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625707.938173:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625707.938245:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938251:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625707.938268:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7a00/0x8aede7274cb13623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1362a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938286:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625707.938290:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938308:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340030e00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625707.938311:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.938318:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625707.938324:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625707.938329:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625707.938454:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625707.938462:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8457:x1875509845715840:12345-0@lo:104: Request processed in 991us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.938470:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625707.938487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625707.938495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845716096:12345-0@lo:104: 00010000:00010000:3.0:1788625707.938503:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.938613:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625707.938619:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8457:x1875509845716096:12345-0@lo:104: Request processed in 126us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.938624:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788625707.938641:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625707.938646:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.938652:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7e00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625707.938655:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.938662:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625707.938668:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625707.938680:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625707.938908:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625707.938915:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8457:x1875509845715968:12345-0@lo:104: Request processed in 1077us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625707.938922:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625707.939020:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875509845716096:0@lo:104: 00010000:00010000:0.0:1788625707.939064:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939179:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939186:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625707.939194:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939200:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340030e00/0x8aede7274cb13615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1361c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939212:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625707.939215:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939221:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625707.939224:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939242:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625707.939248:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625707.939253:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625707.939269:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939274:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788625707.939319:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716864:0@lo:103: 00000100:00100000:2.0:1788625707.939360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625707.939596:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.939603:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625707.939632:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939640:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb135c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135c8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939652:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625707.939654:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625707.939656:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625707.939669:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716608:0@lo:103: 00000100:00100000:1.0:1788625707.939699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625707.939755:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625707.939762:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716736:0@lo:103: 00000100:00100000:1.0:1788625707.939797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625707.939834:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716864 00000100:00100000:1.0:1788625707.939840:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716864 00010000:00010000:1.0:1788625707.939865:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 16 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625707.939900:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716608 00000100:00100000:1.0:1788625707.939903:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716608 00010000:00010000:1.0:1788625707.939916:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 17 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625707.939926:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716736 00000100:00100000:1.0:1788625707.939928:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716736 00010000:00010000:1.0:1788625707.939936:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625707.939946:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625707.939953:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3308:x1875509845716864:12345-0@lo:103: 00010000:00010000:1.0:1788625707.939964:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625707.939969:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939977:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.939990:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb135c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb135c1 expref: 18 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940004:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625707.940476:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.940488:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7e00/0x8aede7274cb135eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135f2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.940504:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.940506:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.940508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625707.940515:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625707.940595:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3308:x1875509845716864:12345-0@lo:103: Request processed in 641us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625707.940602:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625707.940622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625707.940630:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3310:x1875509845716608:12345-0@lo:103: 00010000:00010000:1.0:1788625707.940648:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625707.940653:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 16 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940663:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 16 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940674:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340030a00/0x8aede7274cb1362a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13623 expref: 16 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940684:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625707.940725:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3310:x1875509845716608:12345-0@lo:103: Request processed in 97us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625707.940753:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625707.940772:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625707.940779:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3310:x1875509845716736:12345-0@lo:103: 00010000:00010000:1.0:1788625707.940786:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625707.940791:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 14 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940800:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 14 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940809:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb1361c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13615 expref: 14 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625707.940818:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625707.940841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3310:x1875509845716736:12345-0@lo:103: Request processed in 63us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625707.940856:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625707.940976:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625707.941013:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625707.941040:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845716992:0@lo:103: 00000100:00100000:3.0:1788625707.941072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625707.941124:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823672960 00000100:00100000:3.0:1788625707.941130:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823672960 00010000:00010000:3.0:1788625707.941154:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 10 pid: 5836 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.941168:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673088 00000100:00100000:3.0:1788625707.941170:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673088 00010000:00010000:3.0:1788625707.941180:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 11 pid: 5835 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.941203:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845716992 00000100:00100000:3.0:1788625707.941206:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845716992 00010000:00010000:3.0:1788625707.941217:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 13 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625707.941228:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1788625707.941234:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+11:2366:x1875509823672960:12345-192.168.201.45@tcp:103: 00010000:00010000:3.0:1788625707.941242:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.941246:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 11 pid: 5836 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941256:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 11 pid: 5836 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941267:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031400/0x8aede7274cb13693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca36 expref: 11 pid: 5836 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941277:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.941317:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823672960:12345-192.168.201.45@tcp:103: Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.941323:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1788625707.941363:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1788625707.941368:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+9:2365:x1875509823673088:12345-192.168.201.45@tcp:103: 00010000:00010000:3.0:1788625707.941376:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.941381:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941401:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941412:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016e00/0x8aede7274cb1368c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca2f expref: 9 pid: 5835 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941421:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.941440:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+8:2365:x1875509823673088:12345-192.168.201.45@tcp:103: Request processed in 71us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.941446:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1788625707.941459:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625707.941465:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:3309:x1875509845716992:12345-0@lo:103: 00010000:00010000:3.0:1788625707.941472:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625707.941477:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 13 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941485:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 13 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941494:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3200/0x8aede7274cb135f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb135eb expref: 13 pid: 5835 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941505:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941512:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941600:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941613:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941620:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941627:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941633:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625707.941637:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941645:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941657:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625707.941665:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625707.941696:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3309:x1875509845716992:12345-0@lo:103: Request processed in 231us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625707.941702:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625707.941763:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845716992:0@lo:103: 00000100:00100000:0.0:1788625707.942036:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716736:0@lo:103: 00000100:00100000:0.0:1788625707.942046:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845716608:0@lo:103: 00010000:00010000:0.0:1788625707.942073:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.942082:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625707.942088:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798da400/0x8aede7274cb136cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625707.944904:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845716864:0@lo:103: 00000100:00100000:1.0:1788625708.023314:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845717376:0@lo:400: 00000100:00100000:1.0:1788625708.023400:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625708.023470:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625708.023478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845717504:0@lo:400: 00000100:00100000:1.0:1788625708.023505:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625708.023548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717376 00000100:00100000:1.0:1788625708.023555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717376 00000100:00100000:1.0:1788625708.023613:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625708.023622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845717376:12345-0@lo:400: 00000100:00100000:1.0:1788625708.023673:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845717376:12345-0@lo:400: Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625708.023680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625708.023715:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717504 00000100:00100000:1.0:1788625708.023720:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717504 00000100:00100000:1.0:1788625708.023769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625708.023776:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845717504:12345-0@lo:400: 00000100:00100000:1.0:1788625708.023808:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845717504:12345-0@lo:400: Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625708.023813:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788625708.023829:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625708.023832:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788625708.023861:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fc06a00 x1875509845717504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625708.023874:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845717504:0@lo:400: 00000100:00100000:1.0:1788625708.023885:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845717376:0@lo:400: 00000100:00100000:3.0:1788625708.024006:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845717248:0@lo:400: 00000100:00100000:3.0:1788625708.024038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625708.024057:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845717760:0@lo:400: 00000100:00100000:3.0:1788625708.024079:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625708.024121:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788625708.024128:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845717120:0@lo:400: 00000100:00100000:3.0:1788625708.024155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625708.024175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845717632:0@lo:400: 00000100:00100000:3.0:1788625708.024195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625708.024402:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717248 00000100:00100000:0.0:1788625708.024407:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717248 00000100:00100000:0.0:1788625708.024443:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717632 00000100:00100000:0.0:1788625708.024447:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717632 00000100:00100000:0.0:1788625708.024474:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625708.024480:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845717248:12345-0@lo:400: 00000100:00100000:0.0:1788625708.024522:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845717248:12345-0@lo:400: Request processed in 43us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625708.024539:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625708.024552:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625708.024558:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845717632:12345-0@lo:400: 00000100:00100000:0.0:1788625708.024587:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845717632:12345-0@lo:400: Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625708.024593:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788625708.024609:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625708.024629:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845717632:0@lo:400: 00000100:00100000:0.0:1788625708.024640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845717248:0@lo:400: 00000100:00100000:1.0:1788625708.027055:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717760 00000100:00100000:1.0:1788625708.027070:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717760 00000100:00100000:1.0:1788625708.027144:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625708.027154:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845717760:12345-0@lo:400: 00000100:00100000:1.0:1788625708.027225:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845717760:12345-0@lo:400: Request processed in 74us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625708.027232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625708.027251:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717120 00000100:00100000:1.0:1788625708.027254:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717120 00000100:00100000:1.0:1788625708.027275:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788625708.027280:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3311:x1875509845717120:12345-0@lo:400: 00000100:00100000:1.0:1788625708.027305:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:3311:x1875509845717120:12345-0@lo:400: Request processed in 25us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625708.027311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788625708.027560:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625708.027589:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845717120:0@lo:400: 00010000:00080000:0.0:1788625708.027605:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fc07480 x1875509845717760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625708.027617:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845717760:0@lo:400: 00010000:00010000:1.0:1788625708.274960:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625708.531542:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845717888:0@lo:13: 00000100:00100000:1.0:1788625708.531620:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625708.531750:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845717888 00000100:00100000:2.0:1788625708.531761:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845717888 00000100:00100000:2.0:1788625708.531816:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625708.531826:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845717888:12345-0@lo:13: 00002000:00000024:2.0:1788625708.531862:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625708.541699:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845717888:12345-0@lo:13: Request processed in 9862us (10066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625708.541715:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788625708.541879:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379ded180 x1875509845717888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625708.541973:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845717888:0@lo:13: 10000000:01000000:0.0:1788625709.106970:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625709.106981:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b437fc51000 from 39 10000000:01000000:0.0:1788625709.106990:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625709.107051:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.107064:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.107078:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.107138:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718016:0@lo:101: 00000100:00100000:0.0:1788625709.107487:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.107543:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.107620:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718016 00000100:00100000:1.0:1788625709.107630:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718016 00000100:00100000:1.0:1788625709.107694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788625709.107704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+12:5838:x1875509845718016:12345-0@lo:101: 00010000:00010000:1.0:1788625709.107717:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625709.107769:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb136d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb136d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.107806:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb136d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb136d2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.107819:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb136d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb136d2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.107829:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2c00, rc 0) 00000100:00100000:1.0:1788625709.107880:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718016:12345-0@lo:101: Request processed in 177us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.107887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788625709.107977:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718016:0@lo:101: 00010000:00010000:0.0:1788625709.107992:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.108001:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.108054:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718144:0@lo:501: 00000100:00100000:0.0:1788625709.108093:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.108120:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.108342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718144 00000100:00100000:1.0:1788625709.108361:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718144 00000100:00100000:1.0:1788625709.108394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788625709.108403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718144:12345-0@lo:501: 00000100:00100000:1.0:1788625709.108658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718144:12345-0@lo:501: Request processed in 256us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.108664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788625709.109511:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718144:0@lo:501: 00000100:00100000:0.0:1788625709.109556:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718272:0@lo:503: 00000100:00100000:0.0:1788625709.109612:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.109652:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.110876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718272 00000100:00100000:1.0:1788625709.110901:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718272 00000100:00100000:1.0:1788625709.110962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788625709.110971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718272:12345-0@lo:503: 00000100:00100000:1.0:1788625709.112580:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718272:12345-0@lo:503: Request processed in 1603us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.112593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788625709.113624:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718272:0@lo:503: 00000100:00100000:0.0:1788625709.116835:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8474:1875509845718400:0@lo:502: 00000100:00100000:0.0:1788625709.116921:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.116968:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.118032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718400 00000100:00100000:1.0:1788625709.118042:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718400 00000100:00100000:1.0:1788625709.118109:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625709.118130:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:8474:x1875509845718400:12345-0@lo:502: 00000100:00100000:1.0:1788625709.118702:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:8474:x1875509845718400:12345-0@lo:502: Request processed in 572us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.118710:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788625709.119593:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8474:1875509845718400:0@lo:502: 00000100:00100000:0.0:1788625709.119675:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8474:1875509845718528:0@lo:502: 00000100:00100000:0.0:1788625709.119771:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.119813:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625709.120071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718528 00000100:00100000:2.0:1788625709.120095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718528 00000100:00100000:2.0:1788625709.120153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788625709.120172:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:8474:x1875509845718528:12345-0@lo:502: 00000100:00100000:2.0:1788625709.120759:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:8474:x1875509845718528:12345-0@lo:502: Request processed in 596us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625709.120768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788625709.122416:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8474:1875509845718528:0@lo:502: 00000040:00080000:0.0:1788625709.122468:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788625709.122793:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788625709.122813:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625709.122825:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.122835:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625709.122845:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788625709.122848:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788625709.122850:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788625709.122888:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.122896:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.122905:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625709.122926:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718656:0@lo:101: 00000100:00100000:3.0:1788625709.122988:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625709.123033:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.123177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718656 00000100:00100000:1.0:1788625709.123185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718656 00000100:00100000:1.0:1788625709.123242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788625709.123251:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+13:5838:x1875509845718656:12345-0@lo:101: 00010000:00010000:1.0:1788625709.123264:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625709.123276:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb136e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb136e0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.123299:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb136e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb136e0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.123310:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb136e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb136e0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.123318:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3a00, rc 0) 00000100:00100000:1.0:1788625709.123755:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845718656:12345-0@lo:101: Request processed in 478us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.123762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788625709.124271:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718656:0@lo:101: 00010000:00010000:0.0:1788625709.124290:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.124300:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.124556:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718784:0@lo:501: 00000100:00100000:0.0:1788625709.124598:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.124625:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.124803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718784 00000100:00100000:1.0:1788625709.124811:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718784 00000100:00100000:1.0:1788625709.124855:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788625709.124865:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845718784:12345-0@lo:501: 00000100:00100000:1.0:1788625709.125161:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845718784:12345-0@lo:501: Request processed in 296us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.126028:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788625709.126187:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718784:0@lo:501: 00000100:00100000:0.0:1788625709.126851:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718912:0@lo:503: 00000100:00100000:0.0:1788625709.126993:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.127415:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.133572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845718912 00000100:00100000:1.0:1788625709.133588:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845718912 00000100:00100000:3.0:1788625709.133697:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625709.133709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845718912:12345-0@lo:503: 00000100:00100000:3.0:1788625709.134001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845718912:12345-0@lo:503: Request processed in 293us (7007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.134008:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788625709.134321:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845718912:0@lo:503: 00000100:00100000:3.0:1788625709.135265:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8475:1875509845719040:0@lo:502: 00000100:00100000:3.0:1788625709.135330:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625709.135387:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.135688:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719040 00000100:00100000:0.0:1788625709.135696:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719040 00000100:00100000:0.0:1788625709.135760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788625709.135770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:8475:x1875509845719040:12345-0@lo:502: 00000100:00100000:0.0:1788625709.135985:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:8475:x1875509845719040:12345-0@lo:502: Request processed in 216us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.136002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788625709.136108:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8475:1875509845719040:0@lo:502: 00000020:01000000:2.0:1788625709.136136:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625709.136145:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625709.136147:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625709.136152:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788625709.136190:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8475:1875509845719168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.136237:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625709.136266:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.136582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719168 00000100:00100000:0.0:1788625709.136588:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719168 00000100:00100000:0.0:1788625709.136611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788625709.136618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:8475:x1875509845719168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.136779:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:8475:x1875509845719168:12345-0@lo:502:llog_process_th.0 Request processed in 160us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.136786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625709.137246:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8475:1875509845719168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625709.137273:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625709.137278:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625709.137279:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625709.137283:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788625709.137584:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788625709.137604:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788625709.137615:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137627:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625709.137638:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625709.137641:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4377f6e800 from 39 10000000:01000000:0.0:1788625709.137644:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625709.137676:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137684:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137694:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.137712:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.137793:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.137829:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.137849:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719296 00000100:00100000:0.0:1788625709.137854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719296 00000100:00100000:0.0:1788625709.137880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788625709.137901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:5838:x1875509845719296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625709.137912:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625709.137927:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798db600/0x8aede7274cb136f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb136ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137948:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798db600/0x8aede7274cb136f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb136ee expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137959:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798db600/0x8aede7274cb136f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb136ee expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.137968:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db600, rc 0) 00000100:00100000:0.0:1788625709.138002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.138009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788625709.138043:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625709.138059:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.138090:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.138137:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.138523:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.138542:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.138559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719424 00000100:00100000:0.0:1788625709.138563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719424 00000100:00100000:0.0:1788625709.138587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788625709.138594:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.138877:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.138897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788625709.138934:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.138977:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.139016:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.139038:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.139049:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719552 00000100:00100000:0.0:1788625709.139052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719552 00000100:00100000:0.0:1788625709.140617:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625709.140636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.140874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.140893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625709.140958:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.141203:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8476:1875509845719680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.141858:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.141961:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436038e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.142559:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719680 00000100:00100000:1.0:1788625709.142570:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719680 00000100:00100000:1.0:1788625709.142604:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788625709.142612:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:8476:x1875509845719680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625709.142899:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:8476:x1875509845719680:12345-0@lo:502:llog_process_th.0 Request processed in 286us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.142907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788625709.143911:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8476:1875509845719680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.144013:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8476:1875509845719808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.144104:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.144138:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4360019b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.144564:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719808 00000100:00100000:1.0:1788625709.144574:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719808 00000100:00100000:1.0:1788625709.144626:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788625709.144634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:8476:x1875509845719808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625709.144925:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:8476:x1875509845719808:12345-0@lo:502:llog_process_th.0 Request processed in 290us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.144932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788625709.145835:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8476:1875509845719808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788625709.145875:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788625709.147140:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788625709.147181:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625709.147194:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.147208:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625709.147227:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788625709.147230:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788625709.147250:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625709.147289:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.147297:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.147307:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625709.147334:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.147688:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.147797:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.147965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845719936 00000100:00100000:0.0:1788625709.147974:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845719936 00000100:00100000:0.0:1788625709.148030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788625709.148040:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:5838:x1875509845719936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625709.148054:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625709.148076:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798da200/0x8aede7274cb13703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb136fc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.148111:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798da200/0x8aede7274cb13703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb136fc expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.148121:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798da200/0x8aede7274cb13703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb136fc expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.148130:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da200, rc 0) 00000100:00100000:0.0:1788625709.148558:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845719936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 517us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.148565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788625709.148719:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845719936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625709.148761:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.148772:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625709.148839:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.148868:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.148904:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.148996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720064 00000100:00100000:3.0:1788625709.149002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720064 00000100:00100000:3.0:1788625709.149032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788625709.149039:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845720064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625709.149564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845720064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.149574:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788625709.149772:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.149816:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.149862:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.149896:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625709.150011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720192 00000100:00100000:2.0:1788625709.150017:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720192 00000100:00100000:2.0:1788625709.150053:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788625709.150061:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845720192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625709.150249:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845720192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625709.150267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625709.151030:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.151761:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8477:1875509845720320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625709.151823:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.151855:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625709.152025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720320 00000100:00100000:2.0:1788625709.152037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720320 00000100:00100000:2.0:1788625709.152090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788625709.152099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:8477:x1875509845720320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.152562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:8477:x1875509845720320:12345-0@lo:502:llog_process_th.0 Request processed in 464us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625709.152570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788625709.152676:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8477:1875509845720320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625709.152700:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625709.152708:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625709.152711:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788625709.152715:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788625709.152768:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8477:1875509845720448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625709.152802:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.152872:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.154586:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720448 00000100:00100000:3.0:1788625709.154599:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720448 00000100:00100000:3.0:1788625709.154656:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788625709.154665:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:8477:x1875509845720448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625709.155105:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:8477:x1875509845720448:12345-0@lo:502:llog_process_th.0 Request processed in 439us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.155113:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788625709.155613:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8477:1875509845720448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625709.155655:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625709.155664:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625709.155666:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625709.155672:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788625709.155945:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788625709.155967:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788625709.155979:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.156006:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625709.156018:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625709.156020:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4346652800 from 39 10000000:01000000:0.0:1788625709.156024:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625709.156056:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.156077:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.156095:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.156119:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.156177:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.156216:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.156667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720576 00000100:00100000:1.0:1788625709.156674:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720576 00000100:00100000:1.0:1788625709.156717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788625709.156757:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845720576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625709.156769:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625709.156783:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2600/0x8aede7274cb13711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1370a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.156806:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2600/0x8aede7274cb13711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1370a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.156830:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2600/0x8aede7274cb13711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1370a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625709.156838:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2600, rc 0) 00000100:00100000:1.0:1788625709.156877:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845720576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.158208:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625709.158247:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.158260:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.158607:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.158669:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.158724:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625709.159141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788625709.159497:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720704 00000100:00100000:1.0:1788625709.159506:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720704 00000100:00100000:1.0:1788625709.159553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788625709.159562:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845720704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.160936:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.160992:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.170086:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.170140:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.172855:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720832 00000100:00100000:3.0:1788625709.172870:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720832 00000100:00100000:3.0:1788625709.172944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788625709.172956:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845720832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625709.173294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845720832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (3232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.173311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788625709.173508:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625709.173803:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8478:1875509845720960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.173854:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625709.173879:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345619480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.174650:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845720960 00000100:00100000:3.0:1788625709.174660:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845720960 00000100:00100000:3.0:1788625709.174694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625709.174703:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8478:x1875509845720960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625709.174998:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8478:x1875509845720960:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.175006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788625709.175710:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8478:1875509845720960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.175793:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8478:1875509845721088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.175845:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625709.175873:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.175962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721088 00000100:00100000:0.0:1788625709.175968:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721088 00000100:00100000:0.0:1788625709.175999:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788625709.176008:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8478:x1875509845721088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.176217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8478:x1875509845721088:12345-0@lo:502:llog_process_th.0 Request processed in 210us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.176232:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788625709.176369:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8478:1875509845721088:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788625709.176389:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788625709.176660:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788625709.176679:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625709.176689:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.176699:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625709.176720:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788625709.176723:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788625709.176752:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625709.176779:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.176787:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.176810:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.176827:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.176874:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.176902:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625709.181626:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721216 00000100:00100000:2.0:1788625709.181643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721216 00000100:00100000:2.0:1788625709.181695:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788625709.181706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845721216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625709.181725:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625709.181765:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016a00/0x8aede7274cb1371f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13718 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.181797:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016a00/0x8aede7274cb1371f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13718 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.181825:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016a00/0x8aede7274cb1371f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13718 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.181834:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016a00, rc 0) 00000100:00100000:2.0:1788625709.181928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625709.181936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788625709.182124:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625709.182144:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.182155:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.182239:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.182277:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.182316:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.183359:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721344 00000100:00100000:3.0:1788625709.183371:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721344 00000100:00100000:3.0:1788625709.183414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625709.183422:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625709.183775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.183783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788625709.184108:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.184156:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.184208:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.184251:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.184490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721472 00000100:00100000:3.0:1788625709.184497:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721472 00000100:00100000:3.0:1788625709.184523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788625709.184531:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625709.184688:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.184695:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788625709.185807:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625709.187807:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845720704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 28236us (29126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625709.187823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788625709.190442:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8479:1875509845721600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625709.190549:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625709.190586:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625709.193561:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721600 00000100:00100000:3.0:1788625709.193578:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721600 00000100:00100000:3.0:1788625709.193647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788625709.193657:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8479:x1875509845721600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625709.194016:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8479:x1875509845721600:12345-0@lo:502:llog_process_th.0 Request processed in 360us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625709.194025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788625709.194211:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8479:1875509845721600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625709.194248:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625709.194257:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625709.194259:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788625709.194265:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788625709.194299:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8479:1875509845721728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625709.194341:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625709.194388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721728 00000100:00100000:1.0:1788625709.194392:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721728 00000100:00100000:0.0:1788625709.197191:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b437fc8db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.207143:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788625709.207175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8479:x1875509845721728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625709.207488:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8479:x1875509845721728:12345-0@lo:502:llog_process_th.0 Request processed in 331us (13145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625709.207497:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788625709.207613:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8479:1875509845721728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625709.207656:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625709.207668:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625709.207670:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625709.207675:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788625709.208631:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788625709.208655:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788625709.208667:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.208679:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625709.208689:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788625709.208692:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b4346390000 from 1 10000000:01000000:0.0:1788625709.208695:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788625709.210693:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.210710:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625709.210723:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625709.210852:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.210985:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625709.211089:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625709.216147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721856 00000100:00100000:2.0:1788625709.216173:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721856 00000100:00100000:2.0:1788625709.216602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788625709.216615:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845721856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625709.216634:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625709.216653:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016600/0x8aede7274cb1372d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.216682:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016600/0x8aede7274cb1372d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13726 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.216694:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016600/0x8aede7274cb1372d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13726 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625709.216704:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016600, rc 0) 00000100:00100000:2.0:1788625709.216851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625709.216871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788625709.216964:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625709.216984:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.216994:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625709.217086:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625709.217124:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625709.217707:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625709.217951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845721984 00000100:00100000:0.0:1788625709.217959:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845721984 00000100:00100000:0.0:1788625709.217995:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788625709.218013:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625709.219324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845721984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1305us (2193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625709.219337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788625709.219636:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845721984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788625709.219675:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788625709.219684:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.219696:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625709.298997:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625710.323154:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625711.346976:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625711.604579:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625711.604602:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845722112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625711.604672:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625711.604839:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722112 00000100:00100000:0.0:1788625711.604847:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722112 00000100:00100000:0.0:1788625711.604916:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625711.604936:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845722112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625711.604971:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625711.605015:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845722112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625711.605022:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788625711.605226:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625711.605258:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e3100 x1875509845722112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625711.605276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845722112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788625712.371621:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625712.790084:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625712.790297:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673344 00000100:00100000:2.0:1788625712.790308:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673344 00000100:00100000:2.0:1788625712.790383:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625712.790395:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823673344:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1788625712.790475:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823673344:12345-192.168.201.45@tcp:400: Request processed in 83us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625712.790484:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00080000:1.0:1788625712.790641:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625712.807578:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625712.807635:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625712.807670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625712.807856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673216 00000100:00100000:0.0:1788625712.807868:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673216 00000100:00100000:0.0:1788625712.807980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:0.0:1788625712.807992:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+8:2366:x1875509823673216:12345-192.168.201.45@tcp:400: 00000100:00100000:0.0:1788625712.808071:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+8:2366:x1875509823673216:12345-192.168.201.45@tcp:400: Request processed in 81us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625712.808078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:1.0:1788625712.811225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673600 00000100:00100000:1.0:1788625712.811242:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673600 00000100:00100000:1.0:1788625712.811332:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673472 00000100:00100000:1.0:1788625712.811336:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673472 00000100:00100000:1.0:1788625712.811363:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1788625712.811373:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823673600:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625712.811453:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823673600:12345-192.168.201.45@tcp:400: Request processed in 82us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625712.811461:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1788625712.811478:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1788625712.811484:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823673472:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1788625712.811507:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823673472:12345-192.168.201.45@tcp:400: Request processed in 23us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625712.811590:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00080000:0.0:1788625712.812783:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625712.812790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625713.141701:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845722368:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.141803:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.141872:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845722880:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.141899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.141945:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788625713.141952:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845722240:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.141982:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.142037:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845722752:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.142092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722368 00000100:00100000:1.0:1788625713.142100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722368 00000100:00100000:1.0:1788625713.142150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722752 00000100:00100000:1.0:1788625713.142154:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722752 00000100:00100000:1.0:1788625713.142188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788625713.142198:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845722368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625713.142202:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625713.142215:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845722752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142268:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845722368:12345-0@lo:400:kworker.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625713.142277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625713.142280:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845722752:12345-0@lo:400:kworker.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625713.142290:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788625713.142307:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625713.142321:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722880 00000100:00100000:1.0:1788625713.142325:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722880 00000100:00100000:2.0:1788625713.142333:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845722624:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142355:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625713.142363:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845722880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625713.142380:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.142408:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845722880:12345-0@lo:400:kworker.0 Request processed in 45us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625713.142415:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625713.142419:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625713.142427:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722624 00000100:00100000:2.0:1788625713.142430:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142432:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722624 00000100:00100000:2.0:1788625713.142463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625713.142468:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625713.142477:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845722624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142520:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845722624:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625713.142527:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788625713.142543:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625713.142548:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3d880 x1875509845722624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625713.142548:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625713.142565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845722624:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142570:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845722752:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142584:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845722368:0@lo:400:kworker.0 00010000:00080000:1.0:1788625713.142597:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbc380 x1875509845722880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625713.142598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722496 00000100:00100000:1.0:1788625713.142608:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788625713.142614:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722496 00000100:00100000:2.0:1788625713.142657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788625713.142659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845722240 00000100:00100000:1.0:1788625713.142664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845722240 00000100:00100000:2.0:1788625713.142665:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142693:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788625713.142702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625713.142718:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875509845722496:12345-0@lo:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625713.142726:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788625713.142768:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845722240:12345-0@lo:400:kworker.0 Request processed in 68us (785us total) trans 0 rc 0/0 00000100:00080000:2.0:1788625713.142775:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625713.142776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788625713.142804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875509845722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788625713.142829:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845722240:0@lo:400:kworker.0 00010000:00010000:3.0:1788625713.397289:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625713.651083:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625713.651118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845723008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625713.651193:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625713.651841:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723008 00000100:00100000:0.0:1788625713.651863:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723008 00000100:00100000:0.0:1788625713.651931:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625713.651941:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845723008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625713.651980:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625713.652080:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845723008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625713.652088:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788625713.652134:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dec000 x1875509845723008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625713.652157:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845723008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625714.419115:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625715.350502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625715.350625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673728 00000100:00100000:2.0:1788625715.350635:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673728 00000100:00100000:2.0:1788625715.350698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:2.0:1788625715.350709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+8:5606:x1875509823673728:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1788625715.350757:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625715.350777:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016e00/0x8aede7274cb13734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625715.350807:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016e00/0x8aede7274cb13734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca98 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625715.350820:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016e00/0x8aede7274cb13734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca98 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625715.350830:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016e00, rc 0) 00000100:00100000:2.0:1788625715.350893:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823673728:12345-192.168.201.45@tcp:101: Request processed in 186us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625715.350899:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:1.0:1788625715.353269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625715.353457:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673856 00000100:00100000:0.0:1788625715.353468:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673856 00000100:00100000:0.0:1788625715.353526:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:0.0:1788625715.353536:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823673856:12345-192.168.201.45@tcp:501: 00000100:00100000:0.0:1788625715.353871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823673856:12345-192.168.201.45@tcp:501: Request processed in 335us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625715.353879:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:3.0:1788625715.360339:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625715.360455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823673984 00000100:00100000:1.0:1788625715.360471:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823673984 00000100:00100000:1.0:1788625715.360543:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:1.0:1788625715.360553:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823673984:12345-192.168.201.45@tcp:503: 00000100:00100000:1.0:1788625715.360848:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823673984:12345-192.168.201.45@tcp:503: Request processed in 294us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625715.360858:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:1.0:1788625715.367386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625715.367712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674112 00000100:00100000:2.0:1788625715.367723:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674112 00000100:00100000:2.0:1788625715.367800:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:2.0:1788625715.367810:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:6110:x1875509823674112:12345-192.168.201.45@tcp:502: 00000100:00100000:2.0:1788625715.368121:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:6110:x1875509823674112:12345-192.168.201.45@tcp:502: Request processed in 312us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625715.368130:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:3.0:1788625715.377954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625715.378086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674240 00000100:00100000:0.0:1788625715.378097:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674240 00000100:00100000:0.0:1788625715.378163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:0.0:1788625715.378174:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:6110:x1875509823674240:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625715.378504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:6110:x1875509823674240:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 331us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625715.378513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:1.0:1788625715.401359:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625715.402017:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674368 00000100:00100000:3.0:1788625715.402028:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674368 00000100:00100000:3.0:1788625715.402088:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:3.0:1788625715.402099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823674368:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625715.402115:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625715.402134:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1373b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ca9f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625715.402162:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1373b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca9f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625715.402174:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1373b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca9f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625715.402182:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7e00, rc 0) 00000100:00100000:3.0:1788625715.402246:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823674368:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 149us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625715.402253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:3.0:1788625715.407291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625715.409170:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674496 00000100:00100000:2.0:1788625715.409187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674496 00000100:00100000:2.0:1788625715.409278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:2.0:1788625715.409290:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823674496:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625715.409622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823674496:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 332us (2345us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625715.409630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 175 00010000:00010000:3.0:1788625715.442893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625716.469146:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625716.723232:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845723136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625716.723328:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625716.723583:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723136 00000100:00100000:3.0:1788625716.723595:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723136 00000100:00100000:3.0:1788625716.723677:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625716.723688:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845723136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625716.724872:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625716.724975:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845723136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1287us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625716.724984:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788625716.725152:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625716.725325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fc04000 x1875509845723136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625716.725356:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845723136:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788625716.784537:0:8519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcd4cbea0 20000000:00000080:2.0:1788625716.784557:0:8519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b437fc45c00 uarg=0000000000000000 20000000:01000000:2.0:1788625716.784598:0:8519:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625716.784605:0:8519:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625716.784609:0:8519:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788625716.785918:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788625716.786117:0:8519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788625716.791133:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788625716.791193:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788625716.791251:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788625716.791280:0:8519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625716.791303:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791321:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791330:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13512 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791338:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb135dd expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791349:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791357:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791410:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791428:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 9 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.791445:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723264:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625716.791563:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791573:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.791582:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723392:0@lo:104: 00000100:00100000:3.0:1788625716.791620:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625716.791675:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791683:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 18 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.791692:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723520:0@lo:104: 00000100:00100000:3.0:1788625716.791717:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625716.791840:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625716.791849:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 18 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.791870:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723648:0@lo:104: 00000100:00100000:3.0:1788625716.791892:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625716.792142:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788625716.792163:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625716.792180:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723392 00000100:00100000:2.0:1788625716.792188:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723392 00000100:00100000:2.0:1788625716.792224:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723520 00000100:00100000:2.0:1788625716.792227:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723520 00000100:00100000:2.0:1788625716.792236:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723648 00000100:00100000:2.0:1788625716.792239:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723648 00000100:00100000:2.0:1788625716.792251:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625716.792259:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8519:x1875509845723392:12345-0@lo:104: 00010000:00010000:2.0:1788625716.792283:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792345:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625716.792351:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:8519:x1875509845723392:12345-0@lo:104: Request processed in 93us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.792358:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625716.792373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625716.792378:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435d976c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8519:x1875509845723520:12345-0@lo:104: 00010000:00010000:2.0:1788625716.792386:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792415:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625716.792420:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435d976c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:8519:x1875509845723520:12345-0@lo:104: Request processed in 42us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.792426:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625716.792456:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625716.792461:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8519:x1875509845723648:12345-0@lo:104: 00010000:00010000:2.0:1788625716.792480:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792523:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788625716.792529:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:8519:x1875509845723648:12345-0@lo:104: Request processed in 68us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.792535:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788625716.792555:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625716.792560:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792566:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625716.792576:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792585:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625716.792592:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625716.792598:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625716.792626:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792632:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625716.792651:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792658:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d2200/0x8aede7274cb135dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb135e4 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792676:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625716.792680:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792685:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340031800 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625716.792688:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.792695:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625716.792712:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625716.792718:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625716.793145:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793152:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625716.793159:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793166:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13512 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13519 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793177:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625716.793180:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793186:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625716.793189:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793196:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625716.793203:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625716.793208:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625716.793225:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793231:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625716.793252:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793259:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371016200/0x8aede7274cb134b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb134b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793271:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625716.793273:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625716.793274:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625716.793280:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625716.793298:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845723776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625716.793330:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625716.793357:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625716.793362:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845723904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625716.793378:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625716.793403:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723776 00000100:00100000:2.0:1788625716.793408:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723776 00010000:00010000:2.0:1788625716.793428:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 19 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625716.793446:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845723904 00000100:00100000:2.0:1788625716.793448:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845723904 00010000:00010000:2.0:1788625716.793456:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 20 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625716.793483:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625716.793490:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3310:x1875509845723776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625716.793504:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625716.793509:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793518:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793534:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625716.793558:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3310:x1875509845723776:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.793564:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625716.793575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625716.793580:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845723904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625716.793586:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625716.793590:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 19 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793598:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 19 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.793606:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625716.793621:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3310:x1875509845723904:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.793627:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625716.793661:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845723904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625716.793668:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845723776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625716.793962:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845724032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625716.793988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625716.795712:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031000/0x8aede7274cb135e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb135dd expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.795758:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723392:0@lo:104: 00010000:00010000:3.0:1788625716.795784:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016800/0x8aede7274cb13519 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13512 expref: 17 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625716.795793:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723520:0@lo:104: 00000100:00100000:3.0:1788625716.795801:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723648:0@lo:104: 00010000:00010000:0.0:1788625716.796261:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625716.796406:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724032 00000100:00100000:2.0:1788625716.796427:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724032 00010000:00010000:2.0:1788625716.796459:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 17 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625716.796596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625716.796606:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3308:x1875509845724032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625716.796622:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625716.796628:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 17 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.796637:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 17 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.796654:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3000/0x8aede7274cb134b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb134b0 expref: 17 pid: 5834 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.796873:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625716.796991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845724032:12345-0@lo:103:ldlm_bl.0 Request processed in 386us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.796999:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625716.797348:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845724032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625716.798258:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1875509845723264:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625716.798361:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625716.799105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625716.799355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674624 00000100:00100000:2.0:1788625716.799362:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674624 00010000:00010000:2.0:1788625716.799392:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625716.799455:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1788625716.799464:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823674624:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625716.799486:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625716.799492:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799512:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799529:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3600/0x8aede7274cb136a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca67 expref: 10 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799542:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799548:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799559:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799564:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799568:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799573:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799577:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625716.799579:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799584:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799608:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625716.799615:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625716.799654:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:2366:x1875509823674624:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 192us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625716.799664:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00010000:00010000:0.0:1788625716.799709:0:8519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625716.799717:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625716.799724:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb13742 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625717.495050:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625717.909299:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625717.909341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625717.909381:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625717.909407:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625717.909432:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674880 00000100:00100000:3.0:1788625717.909441:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674880 00000100:00100000:3.0:1788625717.909501:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1788625717.909511:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823674880:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625717.909580:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823674880:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625717.909588:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1788625717.909672:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675008 00000100:00100000:1.0:1788625717.909676:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675008 00000100:00100000:1.0:1788625717.909712:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675136 00000100:00100000:1.0:1788625717.909716:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675136 00000100:00100000:1.0:1788625717.909760:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1788625717.909767:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823675008:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625717.909796:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823675008:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625717.909803:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1788625717.909816:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1788625717.909822:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823675136:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625717.909841:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823675136:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 20us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625717.909852:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00080000:1.0:1788625717.909870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625717.909873:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625717.909876:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625717.910240:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823674752 00000100:00100000:0.0:1788625717.910245:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823674752 00000100:00100000:0.0:1788625717.910285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:0.0:1788625717.910292:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:2365:x1875509823674752:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625717.910332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+9:2365:x1875509823674752:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625717.910338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:2.0:1788625718.259629:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788625718.259701:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.260035:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845724160:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.260228:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.260277:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.260313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.260345:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625718.260353:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.260381:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.260416:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845724416:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.260437:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.260466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724160 00000100:00100000:3.0:1788625718.260473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724160 00000100:00100000:3.0:1788625718.260526:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788625718.260534:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3309:x1875509845724160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.260580:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3309:x1875509845724160:12345-0@lo:400:kworker.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.260587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788625718.260615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724288 00000100:00100000:3.0:1788625718.260618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724288 00000100:00100000:3.0:1788625718.260636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724672 00000100:00100000:3.0:1788625718.260638:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724672 00000100:00100000:2.0:1788625718.261305:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788625718.261344:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625718.261677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724416 00000100:00100000:2.0:1788625718.261684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724416 00000100:00100000:2.0:1788625718.261716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625718.261723:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845724288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.261770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625718.261780:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845724416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.261823:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845724416:12345-0@lo:400:kworker.0 Request processed in 44us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.261830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625718.261843:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625718.262002:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.262039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845724672:12345-0@lo:400:kworker.0 Request processed in 190us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.262059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625718.262522:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724544 00000100:00100000:3.0:1788625718.262529:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724544 00000100:00100000:3.0:1788625718.262557:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724800 00000100:00100000:3.0:1788625718.262561:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724800 00000100:00100000:3.0:1788625718.262579:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625718.262586:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.262621:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845724544:12345-0@lo:400:kworker.0 Request processed in 35us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.262627:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625718.262639:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625718.262645:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845724800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625718.263274:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845724288:12345-0@lo:400:kworker.0 Request processed in 1548us (3569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625718.263282:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625718.263466:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845724288:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.263520:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845724800:12345-0@lo:400:kworker.0 Request processed in 873us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.263528:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788625718.263567:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625718.263571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625718.263574:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625718.263616:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845724416:0@lo:400:kworker.0 00010000:00080000:3.0:1788625718.263649:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbc700 x1875509845724544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788625718.264903:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbe300 x1875509845724800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625718.264917:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845724800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.265018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.265034:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845724160:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.265045:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788625718.423169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625718.423282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675264 00000100:00100000:2.0:1788625718.423298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675264 00000100:00100000:2.0:1788625718.423353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:2.0:1788625718.423362:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:5606:x1875509823675264:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625718.423379:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625718.423396:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7caa6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.423571:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.423585:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.423595:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017e00, rc 0) 00000100:00100000:2.0:1788625718.423966:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823675264:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 603us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625718.423974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:1.0:1788625718.427370:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625718.427459:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675392 00000100:00100000:3.0:1788625718.427470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675392 00000100:00100000:3.0:1788625718.427531:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:3.0:1788625718.427545:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823675392:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.428323:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823675392:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 776us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.428333:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:0.0:1788625718.431333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625718.431464:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675520 00000100:00100000:2.0:1788625718.431476:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675520 00000100:00100000:2.0:1788625718.431531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:2.0:1788625718.431543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823675520:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.431984:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:5606:x1875509823675520:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 441us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625718.431992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:1.0:1788625718.436402:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625718.437104:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675648 00000100:00100000:0.0:1788625718.437114:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675648 00000100:00100000:0.0:1788625718.437267:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:0.0:1788625718.437279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:6173:x1875509823675648:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625718.437561:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:6173:x1875509823675648:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 283us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625718.437567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1788625718.440961:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625718.441041:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675776 00000100:00100000:3.0:1788625718.441051:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675776 00000100:00100000:3.0:1788625718.441109:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:3.0:1788625718.441120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:6173:x1875509823675776:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625718.441393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:6173:x1875509823675776:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 274us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.441401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 10000000:01000000:2.0:1788625718.515221:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625718.515231:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437fc51000 from 4 10000000:01000000:2.0:1788625718.515236:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625718.515288:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.515322:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.515334:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625718.515361:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845724928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.515433:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625718.515480:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625718.515743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845724928 00000100:00100000:0.0:1788625718.515758:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845724928 00010000:00010000:2.0:1788625718.515953:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625718.516151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788625718.516161:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845724928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625718.516175:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625718.516188:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13750 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625718.516213:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13750 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625718.516224:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13750 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625718.516234:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2400, rc 0) 00000100:00100000:1.0:1788625718.516281:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845724928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625718.516287:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788625718.516347:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845724928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625718.516362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625718.516392:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625718.516457:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625718.516482:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625718.516504:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43462e2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625718.516515:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725056 00000100:00100000:1.0:1788625718.516530:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725056 00000100:00100000:1.0:1788625718.516554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788625718.516560:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845725056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625718.517178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845725056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 616us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625718.517185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788625718.517621:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.517659:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.517702:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625718.517754:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.518959:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725184 00000100:00100000:3.0:1788625718.518970:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725184 00000100:00100000:3.0:1788625718.519029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788625718.519039:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845725184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.519270:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845725184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.519277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788625718.519425:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625718.520946:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8587:1875509845725312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.521015:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625718.521415:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625718.521686:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725312 00000100:00100000:2.0:1788625718.521694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725312 00000100:00100000:2.0:1788625718.521756:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788625718.521832:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:8587:x1875509845725312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625718.522912:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:8587:x1875509845725312:12345-0@lo:502:llog_process_th.0 Request processed in 1144us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625718.522935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788625718.523974:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8587:1875509845725312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625718.524034:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625718.524045:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625718.524048:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625718.524055:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b437fc51000 00000020:00000080:0.0:1788625718.524058:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625718.524147:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8587:1875509845725440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.524213:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625718.524244:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.530657:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725440 00000100:00100000:3.0:1788625718.530674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725440 00000100:00100000:3.0:1788625718.534077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788625718.534104:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:8587:x1875509845725440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625718.534413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:8587:x1875509845725440:12345-0@lo:502:llog_process_th.0 Request processed in 319us (10209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.534427:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788625718.535141:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8587:1875509845725440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625718.535177:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625718.535185:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625718.535187:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788625718.535191:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788625718.535395:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788625718.535416:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625718.535426:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.535451:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625718.535463:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625718.535465:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4377f6e800 from 4 10000000:01000000:2.0:1788625718.535468:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625718.535505:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.535513:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625718.535523:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625718.535547:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.535601:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625718.535878:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.539009:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725568 00000100:00100000:3.0:1788625718.539034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725568 00000100:00100000:3.0:1788625718.539098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788625718.539109:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845725568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625718.539126:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625718.539147:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1375e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.539176:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1375e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.539188:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1375e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.539197:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7800, rc 0) 00000100:00100000:3.0:1788625718.539276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845725568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.539283:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788625718.539364:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625718.539383:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.539394:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625718.539472:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.539517:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.539545:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.539560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725696 00000100:00100000:3.0:1788625718.539563:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725696 00000100:00100000:3.0:1788625718.539585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788625718.539591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845725696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.540109:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845725696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 516us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.540117:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788625718.540151:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.540184:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.540223:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.540240:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.540249:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725824 00000100:00100000:3.0:1788625718.540253:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725824 00000100:00100000:3.0:1788625718.540274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788625718.540280:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845725824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.540482:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845725824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.540489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788625718.541002:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845725824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625718.548306:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8591:1875509845725952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625718.548968:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625718.549011:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.549634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845725952 00000100:00100000:3.0:1788625718.549645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845725952 00000100:00100000:3.0:1788625718.549688:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788625718.549697:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8591:x1875509845725952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625718.551552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8591:x1875509845725952:12345-0@lo:502:llog_process_th.0 Request processed in 1851us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.551571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788625718.557134:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8591:1875509845725952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625718.557239:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625718.557249:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625718.557252:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625718.557262:0:8591:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4377f6e800 00000020:00000080:3.0:1788625718.557265:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625718.557702:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8591:1875509845726080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625718.557906:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.557951:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.557973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726080 00000100:00100000:3.0:1788625718.557979:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726080 00000100:00100000:3.0:1788625718.558018:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788625718.558213:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8591:x1875509845726080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625718.558905:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:8591:x1875509845726080:12345-0@lo:502:llog_process_th.0 Request processed in 693us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.558913:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788625718.558978:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8591:1875509845726080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625718.559001:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625718.559006:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625718.559008:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788625718.559014:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788625718.559871:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788625718.559893:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625718.559903:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.559939:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625718.559950:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625718.559952:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346652800 from 4 10000000:01000000:3.0:1788625718.559955:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625718.559987:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.559995:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.560004:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625718.560096:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.560144:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.560227:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.560246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726208 00000100:00100000:3.0:1788625718.560253:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726208 00000100:00100000:3.0:1788625718.560287:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788625718.560294:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845726208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625718.560306:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625718.560387:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1376c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.560412:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1376c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.560433:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1376c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.560441:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625718.560475:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845726208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.560481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788625718.560518:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625718.560532:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625718.560540:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625718.560584:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.560679:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.560693:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625718.560704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726336 00000100:00100000:3.0:1788625718.560707:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726336 00000100:00100000:3.0:1788625718.560860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788625718.560867:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845726336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.561160:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845726336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625718.561235:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788625718.561265:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.561300:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625718.561397:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625718.561692:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625718.565459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726464 00000100:00100000:0.0:1788625718.565471:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726464 00000100:00100000:0.0:1788625718.565521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788625718.565531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845726464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625718.565967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845726464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 436us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625718.565986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788625718.566083:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845726464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625718.566465:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8594:1875509845726592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.566509:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625718.566532:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726592 00000100:00100000:0.0:1788625718.566536:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726592 00000100:00100000:0.0:1788625718.566557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788625718.566563:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:8594:x1875509845726592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.566976:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:8594:x1875509845726592:12345-0@lo:502:llog_process_th.0 Request processed in 413us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625718.566983:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788625718.567087:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625718.567102:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8594:1875509845726592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625718.567124:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625718.567134:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625718.567136:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625718.567143:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4346652800 00000020:00000080:0.0:1788625718.567145:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625718.567276:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8594:1875509845726720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.567310:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625718.568678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726720 00000100:00100000:0.0:1788625718.568689:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726720 00000100:00100000:0.0:1788625718.569042:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788625718.569053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:8594:x1875509845726720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625718.569674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:8594:x1875509845726720:12345-0@lo:502:llog_process_th.0 Request processed in 552us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625718.569691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788625718.569899:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625718.569932:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:8594:1875509845726720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625718.569965:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625718.569973:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625718.569976:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788625718.569980:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788625718.570302:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788625718.570395:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625718.570405:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625718.570492:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625718.775693:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845726848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625718.775819:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625718.776798:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726848 00000100:00100000:0.0:1788625718.776809:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726848 00000100:00100000:0.0:1788625718.776867:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625718.776878:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845726848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625718.776926:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625718.776987:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845726848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625718.776994:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788625718.777292:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dee680 x1875509845726848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625718.777312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845726848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625719.539357:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625720.563497:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625721.587055:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625721.848510:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845726976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625721.848587:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625721.848670:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845726976 00000100:00100000:1.0:1788625721.848678:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845726976 00000100:00100000:1.0:1788625721.848741:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625721.848751:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845726976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625721.848787:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788625721.848955:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625721.850407:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845726976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1650us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625721.850419:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788625721.858658:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbd180 x1875509845726976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625721.858687:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845726976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788625722.619191:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625723.034607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625723.034665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625723.034700:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676032 00000100:00100000:0.0:1788625723.034715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676032 00000100:00100000:0.0:1788625723.034809:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625723.034820:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823676032:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625723.034909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823676032:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625723.034916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00080000:0.0:1788625723.034940:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625723.035119:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823675904 00000100:00100000:1.0:1788625723.035124:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823675904 00000100:00100000:1.0:1788625723.035161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:1.0:1788625723.035168:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823675904:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625723.035197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823675904:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625723.035204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:0.0:1788625723.050004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625723.050244:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676160 00000100:00100000:2.0:1788625723.050254:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676160 00000100:00100000:2.0:1788625723.050318:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1788625723.050329:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2362:x1875509823676160:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1788625723.050365:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb136af 00000100:00080000:2.0:1788625723.050376:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b434f8c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625723.050428:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788625723.051255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00080000:0.0:1788625723.051290:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625723.051762:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788625723.051774:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788625723.051926:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+2:2362:x1875509823676160:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 1597us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625723.051937:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1788625723.051958:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676288 00000100:00100000:2.0:1788625723.051964:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676288 00000100:00100000:2.0:1788625723.052000:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1788625723.052019:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2362:x1875509823676288:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1788625723.052043:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb136b6 00000100:00080000:2.0:1788625723.052051:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b4350f9e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625723.052081:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788625723.052332:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+2:2362:x1875509823676288:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 324us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625723.052339:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00010000:00010000:2.0:1788625723.052422:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625723.052428:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625723.052434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788625723.247399:0:8819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788625723.379005:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625723.379088:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625723.379115:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845727488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625723.379193:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625723.379275:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727488 00000100:00100000:0.0:1788625723.379283:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727488 00000100:00100000:0.0:1788625723.379337:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625723.379348:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845727488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625723.379399:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845727488:12345-0@lo:400:kworker.0 Request processed in 53us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625723.379406:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788625723.379426:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625723.379455:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbc380 x1875509845727488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625723.379469:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845727488:0@lo:400:kworker.0 00000100:00100000:1.0:1788625723.388384:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845727104:0@lo:400:kworker.0 00000100:00100000:1.0:1788625723.388459:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625723.390906:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845727232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.390973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625723.391005:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845727744:0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.391030:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625723.391149:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625723.391166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845727616:0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.391923:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625723.391934:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845727360:0@lo:400:kworker.0 00000100:00100000:1.0:1788625723.399827:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625723.399915:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727232 00000100:00100000:1.0:1788625723.399923:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727232 00000100:00100000:1.0:1788625723.399973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727616 00000100:00100000:1.0:1788625723.399976:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727616 00000100:00100000:1.0:1788625723.400009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625723.400018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845727232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625723.400199:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845727232:12345-0@lo:400:kworker.0 Request processed in 181us (9225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625723.400206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625723.400225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788625723.400242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845727616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625723.400280:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845727616:12345-0@lo:400:kworker.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625723.400295:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788625723.400317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625723.400350:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845727616:0@lo:400:kworker.0 00000100:00100000:0.0:1788625723.400508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727104 00000100:00100000:0.0:1788625723.400514:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727104 00000100:00100000:0.0:1788625723.400582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788625723.400589:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845727104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625723.400625:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845727104:12345-0@lo:400:kworker.0 Request processed in 38us (12166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625723.400632:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788625723.401041:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845727104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.401253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625723.401296:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845727232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.401325:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727360 00000100:00100000:3.0:1788625723.401328:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727360 00000100:00100000:3.0:1788625723.401376:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625723.401384:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845727360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.401418:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845727360:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625723.401424:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625723.401441:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727744 00000100:00100000:3.0:1788625723.401445:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727744 00000100:00100000:3.0:1788625723.401468:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625723.401474:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845727744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625723.401513:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845727744:12345-0@lo:400:kworker.0 Request processed in 40us (10482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625723.401519:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625723.401550:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845727360:0@lo:400:kworker.0 00010000:00080000:3.0:1788625723.401564:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dbc380 x1875509845727744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625723.401574:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845727744:0@lo:400:kworker.0 00000100:00080000:2.0:1788625723.402034:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625723.402039:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625723.638354:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625723.891099:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625723.891174:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625723.891339:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845727872 00000100:00100000:0.0:1788625723.891348:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845727872 00000100:00100000:0.0:1788625723.891400:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625723.891409:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845727872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625723.891445:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625723.891497:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845727872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625723.891505:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788625723.891579:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dee300 x1875509845727872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625723.891597:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845727872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625724.660238:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625725.683981:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788625726.517102:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:3.0:1788625726.517117:0:7653:0:(genops.c:885:class_export_put()) final put ffff9b4350f98000/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000001:00100000:3.0:1788625726.518375:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:3.0:1788625726.518385:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b434f8c5800/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:1.0:1788625726.520378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4350f98000/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-OST0001 00000020:00000080:1.0:1788625726.520451:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434f8c5800/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-OST0000 00000020:00000080:1.0:1788625726.520488:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4350f9e000 for lustre-OST0001 00000020:00000080:1.0:1788625726.520495:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b434f8c7800 for lustre-OST0000 00010000:00010000:2.0:1788625726.709969:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625726.963894:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625726.963938:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845728000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625726.964033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625726.964127:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728000 00000100:00100000:2.0:1788625726.964137:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728000 00000100:00100000:2.0:1788625726.964210:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625726.964223:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845728000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625726.964273:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625726.964326:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845728000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625726.964335:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788625726.964359:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625726.964398:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e1f80 x1875509845728000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625726.964421:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845728000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788625727.731984:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625728.151132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625728.151185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625728.151391:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676416 00000100:00100000:0.0:1788625728.151406:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676416 00000100:00100000:0.0:1788625728.151475:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:0.0:1788625728.151487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823676416:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625728.151591:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823676416:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 106us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625728.151599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1788625728.153909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676544 00000100:00100000:3.0:1788625728.153930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676544 00000100:00100000:3.0:1788625728.154016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1788625728.154029:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823676544:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625728.156025:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823676544:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 1982us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625728.156044:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00080000:3.0:1788625728.156094:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625728.500083:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845728256:0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500183:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625728.500250:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845728768:0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500279:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625728.500317:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625728.500324:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625728.500404:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728256 00000100:00100000:1.0:1788625728.500414:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728256 00000100:00100000:1.0:1788625728.500470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728384 00000100:00100000:1.0:1788625728.500474:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728384 00000100:00100000:1.0:1788625728.500518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788625728.500530:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845728256:12345-0@lo:400:kworker.0 Request processed in 72us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.500609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788625728.500632:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625728.500639:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845728384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500664:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845728384:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.500670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625728.500688:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728768 00000100:00100000:1.0:1788625728.500692:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728768 00000100:00100000:1.0:1788625728.500722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625728.500779:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845728768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500812:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845728768:12345-0@lo:400:kworker.0 Request processed in 84us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.500818:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788625728.500843:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625728.500849:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625728.500894:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.500905:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845728256:0@lo:400:kworker.0 00010000:00080000:1.0:1788625728.500919:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166ea00 x1875509845728768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625728.500929:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845728768:0@lo:400:kworker.0 00000100:00100000:3.0:1788625728.501166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845728512:0@lo:400:kworker.0 00000100:00100000:3.0:1788625728.501207:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625728.501244:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625728.501251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845728128:0@lo:400:kworker.0 00000100:00100000:3.0:1788625728.501281:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625728.501314:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788625728.501351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625728.501562:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728512 00000100:00100000:1.0:1788625728.501569:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728512 00000100:00100000:1.0:1788625728.501625:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625728.501643:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845728512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.501689:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845728512:12345-0@lo:400:kworker.0 Request processed in 48us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.501697:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625728.501719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728128 00000100:00100000:1.0:1788625728.501723:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728128 00000100:00100000:1.0:1788625728.501780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625728.501787:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845728128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.501820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845728128:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.501826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625728.501875:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845728128:0@lo:400:kworker.0 00010000:00080000:1.0:1788625728.501889:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fc04380 x1875509845728512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625728.501897:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845728512:0@lo:400:kworker.0 00000100:00100000:1.0:1788625728.501920:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728640 00000100:00100000:1.0:1788625728.501923:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728640 00000100:00100000:1.0:1788625728.501950:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788625728.501957:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845728640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788625728.502259:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625728.502265:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625728.502307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845728640:12345-0@lo:400:kworker.0 Request processed in 348us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625728.502314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788625728.507321:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845728640:0@lo:400:kworker.0 00010000:00010000:2.0:1788625728.757429:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625728.832859:0:9068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing yml_node 00000100:00100000:3.0:1788625729.011861:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845728896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625729.011954:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625729.012211:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845728896 00000100:00100000:0.0:1788625729.012223:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845728896 00000100:00100000:0.0:1788625729.012288:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625729.012300:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845728896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625729.012351:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625729.012411:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845728896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625729.012427:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788625729.012477:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379deca80 x1875509845728896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625729.012500:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845728896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625729.788842:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625730.808771:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625731.827112:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625732.087181:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845729024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625732.087285:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625732.087570:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729024 00000100:00100000:2.0:1788625732.087584:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729024 00000100:00100000:2.0:1788625732.087672:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625732.087694:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845729024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625732.087768:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625732.087826:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845729024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625732.087834:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788625732.087919:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625732.087977:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e1f80 x1875509845729024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625732.088003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845729024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788625732.855237:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625733.279081:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625733.279142:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625733.279341:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676672 00000100:00100000:0.0:1788625733.279355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676672 00000100:00100000:0.0:1788625733.279425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:0.0:1788625733.279438:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2365:x1875509823676672:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625733.279534:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2365:x1875509823676672:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 98us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.279543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:2.0:1788625733.279898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676800 00000100:00100000:2.0:1788625733.279904:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676800 00000100:00100000:2.0:1788625733.279950:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1788625733.279959:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823676800:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625733.280000:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823676800:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 43us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625733.280006:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00080000:1.0:1788625733.280089:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625733.620631:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845729280:0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.620764:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625733.620842:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845729792:0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.620865:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625733.620924:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625733.620930:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845729408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.620955:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625733.621000:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729280 00000100:00100000:0.0:1788625733.621010:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729280 00000100:00100000:0.0:1788625733.621059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729408 00000100:00100000:0.0:1788625733.621061:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729408 00000100:00100000:0.0:1788625733.621098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625733.621109:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845729280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.621172:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845729280:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.621199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625733.621220:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625733.621226:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845729408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.621252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845729408:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.621256:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625733.621272:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729792 00000100:00100000:0.0:1788625733.621274:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729792 00000100:00100000:0.0:1788625733.621298:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625733.621302:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845729792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.621322:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845729792:12345-0@lo:400:kworker.0 Request processed in 20us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.621326:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788625733.621341:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625733.621345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625733.621378:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845729408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.621386:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845729280:0@lo:400:kworker.0 00010000:00080000:0.0:1788625733.621396:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379ded500 x1875509845729792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625733.621404:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845729792:0@lo:400:kworker.0 00000100:00100000:3.0:1788625733.621865:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845729536:0@lo:400:kworker.0 00000100:00100000:3.0:1788625733.621924:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625733.621973:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625733.621981:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845729152:0@lo:400:kworker.0 00000100:00100000:3.0:1788625733.622011:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625733.622042:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845729664:0@lo:400:kworker.0 00000100:00100000:3.0:1788625733.622065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625733.622915:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729536 00000100:00100000:1.0:1788625733.622929:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729536 00000100:00100000:1.0:1788625733.622990:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625733.623001:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845729536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625733.623073:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845729536:12345-0@lo:400:kworker.0 Request processed in 74us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625733.623081:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788625733.623126:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379def480 x1875509845729536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625733.623141:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845729536:0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.623432:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729152 00000100:00100000:0.0:1788625733.623438:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729152 00000100:00100000:0.0:1788625733.623479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788625733.623487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.623643:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845729152:12345-0@lo:400:kworker.0 Request processed in 156us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.623650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788625733.623704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729664 00000100:00100000:0.0:1788625733.623708:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729664 00000100:00080000:1.0:1788625733.623809:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625733.623850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625733.623858:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845729664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625733.623906:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845729664:12345-0@lo:400:kworker.0 Request processed in 50us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625733.623913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625733.624130:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845729152:0@lo:400:kworker.0 00000100:00100000:3.0:1788625733.624147:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845729664:0@lo:400:kworker.0 00010000:00010000:0.0:1788625733.878097:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625734.016296:0:9259:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:2.0:1788625734.134207:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625734.139995:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845729920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625734.140171:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625734.149493:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845729920 00000100:00100000:0.0:1788625734.149517:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845729920 00000100:00100000:0.0:1788625734.151255:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625734.151285:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845729920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625734.151345:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625734.151483:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845729920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (11312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625734.151492:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788625734.151655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166f800 x1875509845729920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625734.151684:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845729920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625734.900450:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625735.923234:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625736.947996:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625737.202958:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845730048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625737.203050:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625737.203230:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730048 00000100:00100000:2.0:1788625737.203238:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730048 00000100:00100000:2.0:1788625737.203306:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625737.203316:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845730048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625737.203353:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625737.203420:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845730048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625737.203427:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788625737.204012:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625737.204045:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e0380 x1875509845730048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625737.204079:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845730048:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788625737.314110:0:9358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1788625737.975317:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625738.389067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625738.389112:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677056 00000100:00100000:0.0:1788625738.389122:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677056 00000100:00080000:2.0:1788625738.389192:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625738.389201:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1788625738.389212:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823677056:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625738.389290:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823677056:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625738.389305:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1788625738.390630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625738.392028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823676928 00000100:00100000:2.0:1788625738.392040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823676928 00000100:00100000:2.0:1788625738.392102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:2.0:1788625738.392113:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823676928:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625738.392180:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823676928:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 69us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625738.392188:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:1.0:1788625738.739700:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625738.739847:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.739935:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625738.740006:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625738.740013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845730432:0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.740035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625738.742784:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625738.742819:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845730560:0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.742903:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625738.742984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730304 00000100:00100000:0.0:1788625738.742993:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730304 00000100:00100000:0.0:1788625738.743038:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730432 00000100:00100000:0.0:1788625738.743042:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730432 00000100:00100000:0.0:1788625738.743077:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625738.743086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.743151:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845730304:12345-0@lo:400:kworker.0 Request processed in 66us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625738.743159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625738.743177:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625738.743184:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845730432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.743213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845730432:12345-0@lo:400:kworker.0 Request processed in 30us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625738.743219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788625738.743243:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625738.743281:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845730432:0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.743295:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.743763:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730560 00000100:00100000:3.0:1788625738.743768:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730560 00000100:00100000:3.0:1788625738.743808:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625738.743829:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845730560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.743884:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845730560:12345-0@lo:400:kworker.0 Request processed in 56us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625738.743891:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788625738.744000:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3ce00 x1875509845730560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625738.744013:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845730560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625738.744310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845730176:0@lo:400:kworker.0 00000100:00100000:1.0:1788625738.744351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625738.744462:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730176 00000100:00100000:0.0:1788625738.744467:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730176 00000100:00100000:0.0:1788625738.744504:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788625738.744510:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845730176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.744545:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845730176:12345-0@lo:400:kworker.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625738.744551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788625738.744675:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845730176:0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.746094:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845730816:0@lo:400:kworker.0 00000100:00100000:3.0:1788625738.746163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625738.746325:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730816 00000100:00100000:2.0:1788625738.746333:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730816 00000100:00100000:2.0:1788625738.746394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625738.746401:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845730816:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788625738.746484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625738.746499:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845730688:0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.746531:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625738.746576:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730688 00000100:00100000:0.0:1788625738.746580:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730688 00000100:00100000:0.0:1788625738.746614:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625738.746621:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845730688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625738.746655:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845730688:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625738.746662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788625738.746682:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625738.746705:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845730688:0@lo:400:kworker.0 00000100:00100000:2.0:1788625738.749535:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845730816:12345-0@lo:400:kworker.0 Request processed in 3124us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625738.749549:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788625738.749726:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3ed80 x1875509845730816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625738.749759:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845730816:0@lo:400:kworker.0 00010000:00010000:2.0:1788625738.996779:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625739.251347:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625739.251376:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845730944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625739.251450:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625739.251618:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845730944 00000100:00100000:0.0:1788625739.251627:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845730944 00000100:00100000:0.0:1788625739.251684:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625739.251694:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845730944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625739.251753:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625739.251803:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845730944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625739.251821:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788625739.251863:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dec380 x1875509845730944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625739.251883:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845730944:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788625739.560340:0:9455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:2.0:1788625740.019064:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625741.047797:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625741.667095:0:9503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 12:29:00 EDT 2026 00010000:00010000:2.0:1788625742.067325:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625742.323906:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845731072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625742.323999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625742.324195:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731072 00000100:00100000:0.0:1788625742.324207:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731072 00000100:00100000:0.0:1788625742.324297:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625742.324319:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845731072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625742.324366:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788625742.324630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625742.324923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845731072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 615us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625742.324932:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788625742.325018:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4377f3d880 x1875509845731072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625742.325043:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845731072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788625743.090903:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625743.524438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625743.524502:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625743.524572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677184 00000100:00100000:3.0:1788625743.524582:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677184 00000100:00100000:3.0:1788625743.524640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:3.0:1788625743.524650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2363:x1875509823677184:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625743.524716:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2363:x1875509823677184:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625743.524724:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:2.0:1788625743.525090:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677312 00000100:00100000:2.0:1788625743.525104:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677312 00000100:00100000:2.0:1788625743.525278:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1788625743.525296:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823677312:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625743.525337:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823677312:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 52us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625743.525344:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00080000:3.0:1788625743.525916:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625743.859640:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845731200:0@lo:400:kworker.0 00000100:00100000:1.0:1788625743.859753:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625743.859850:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731200 00000100:00100000:2.0:1788625743.859859:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731200 00000100:00100000:2.0:1788625743.859907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788625743.859917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845731200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860088:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845731328:0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860123:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625743.860148:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625743.860154:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845731456:0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860190:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625743.860233:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731328 00000100:00100000:0.0:1788625743.860237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731328 00000100:00100000:0.0:1788625743.860270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731456 00000100:00100000:0.0:1788625743.860274:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731456 00000100:00100000:0.0:1788625743.860317:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625743.860324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845731328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860375:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845731328:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625743.860397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625743.860413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625743.860420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845731456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860464:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845731456:12345-0@lo:400:kworker.0 Request processed in 44us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625743.860483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788625743.860506:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625743.860538:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845731456:0@lo:400:kworker.0 00000100:00100000:0.0:1788625743.860549:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845731328:0@lo:400:kworker.0 00000100:00100000:2.0:1788625743.861501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845731200:12345-0@lo:400:kworker.0 Request processed in 1582us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625743.861510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788625743.861623:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845731200:0@lo:400:kworker.0 00000100:00100000:1.0:1788625743.861637:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625743.861645:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845731584:0@lo:400:kworker.0 00000100:00100000:1.0:1788625743.861678:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625743.862011:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625743.862098:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625743.862109:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845731840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625743.862140:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625743.862415:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845731712:0@lo:400:kworker.0 00000100:00100000:2.0:1788625743.862461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625743.862916:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731584 00000100:00100000:0.0:1788625743.862923:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731584 00000100:00100000:1.0:1788625743.862987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731712 00000100:00100000:1.0:1788625743.862992:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731712 00000100:00100000:1.0:1788625743.863054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625743.863063:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845731712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625743.863113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845731712:12345-0@lo:400:kworker.0 Request processed in 51us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625743.863121:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625743.863151:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845731712:0@lo:400:kworker.0 00000100:00080000:0.0:1788625743.863335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625743.863647:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731840 00000100:00100000:2.0:1788625743.863652:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731840 00000100:00100000:2.0:1788625743.863766:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625743.863775:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845731584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625743.863820:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845731584:12345-0@lo:400:kworker.0 Request processed in 47us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625743.863827:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625743.863839:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625743.863845:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625743.863877:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845731840:12345-0@lo:400:kworker.0 Request processed in 32us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625743.863892:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788625743.864032:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4358382680 x1875509845731840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625743.864044:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845731840:0@lo:400:kworker.0 00010000:00080000:1.0:1788625743.864141:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4358382d80 x1875509845731584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625743.864151:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845731584:0@lo:400:kworker.0 00000100:00080000:0.0:1788625743.864439:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788625744.118955:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625744.372597:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625744.372619:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845731968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625744.372683:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625744.372775:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845731968 00000100:00100000:1.0:1788625744.372783:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845731968 00000100:00100000:1.0:1788625744.372829:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625744.372839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845731968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625744.372873:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625744.372915:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845731968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625744.372922:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788625744.372962:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166c000 x1875509845731968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625744.372980:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845731968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625745.140661:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625746.169901:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625747.187818:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625747.450893:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845732096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625747.450991:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625747.451282:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732096 00000100:00100000:0.0:1788625747.451293:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732096 00000100:00100000:0.0:1788625747.451378:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625747.451388:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845732096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625747.451446:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625747.451505:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845732096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625747.451512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788625747.451595:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379defb80 x1875509845732096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625747.451618:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845732096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788625747.451666:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788625748.212154:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625748.655970:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625748.656024:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625748.656061:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677440 00000100:00100000:3.0:1788625748.656074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677440 00000100:00100000:3.0:1788625748.656149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:3.0:1788625748.656160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823677440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625748.656269:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2364:x1875509823677440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625748.656277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:3.0:1788625748.656321:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677568 00000100:00100000:3.0:1788625748.656324:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677568 00000100:00100000:3.0:1788625748.656367:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:3.0:1788625748.656374:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823677568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625748.656418:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823677568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625748.656426:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00080000:3.0:1788625748.656573:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625748.981147:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845732608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.981258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625748.981342:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788625748.981349:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845732224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.981409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625748.981447:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845732736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.981474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625748.981512:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732608 00000100:00100000:0.0:1788625748.981532:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732608 00000100:00100000:0.0:1788625748.981603:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625748.981614:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845732608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.981675:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845732608:12345-0@lo:400:kworker.0 Request processed in 63us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625748.981683:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625748.981710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732224 00000100:00100000:0.0:1788625748.981714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732224 00000100:00100000:0.0:1788625748.981761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788625748.981768:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.981797:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845732224:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625748.981804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788625748.981851:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845732224:0@lo:400:kworker.0 00010000:00080000:0.0:1788625748.981867:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dedc00 x1875509845732608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625748.981879:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845732608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982126:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845732480:0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982163:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625748.982199:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788625748.982207:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845732352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625748.982263:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845732864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625748.982313:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732864 00000100:00100000:0.0:1788625748.982315:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732736 00000100:00100000:3.0:1788625748.982318:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732864 00000100:00100000:0.0:1788625748.982319:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732736 00000100:00100000:1.0:1788625748.982438:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732480 00000100:00100000:1.0:1788625748.982443:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732480 00000100:00100000:3.0:1788625748.982760:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625748.982770:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845732864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982822:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845732864:12345-0@lo:400:kworker.0 Request processed in 55us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625748.982828:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625748.982854:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732352 00000100:00100000:3.0:1788625748.982858:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732352 00000100:00100000:3.0:1788625748.982945:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625748.982953:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845732352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625748.982986:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845732352:12345-0@lo:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625748.982992:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625748.986496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625748.986515:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625748.988491:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845732736:12345-0@lo:400:kworker.0 Request processed in 1970us (7004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625748.988508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625748.992153:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845732736:0@lo:400:kworker.0 00000100:00100000:2.0:1788625748.996787:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845732352:0@lo:400:kworker.0 00010000:00080000:2.0:1788625748.996818:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379def480 x1875509845732864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625748.996831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845732864:0@lo:400:kworker.0 00000100:00100000:1.0:1788625748.998397:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625748.998430:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845732480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625748.998553:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845732480:12345-0@lo:400:kworker.0 Request processed in 141us (16388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625748.998561:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625749.001970:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845732480:0@lo:400:kworker.0 00000100:00080000:3.0:1788625749.008807:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625749.009115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788625749.235044:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625749.509797:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625749.509829:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845732992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625749.509926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625749.510033:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845732992 00000100:00100000:0.0:1788625749.510042:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845732992 00000100:00100000:0.0:1788625749.510107:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625749.510119:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845732992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625749.510167:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625749.510217:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845732992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625749.510224:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788625749.510275:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e1f80 x1875509845732992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625749.510296:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845732992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625750.262804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625751.283849:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625752.309643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625752.563231:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845733120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625752.563302:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625752.563413:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733120 00000100:00100000:3.0:1788625752.563423:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733120 00000100:00100000:3.0:1788625752.563491:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625752.563502:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845733120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625752.563538:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788625752.563611:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625752.564048:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845733120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 547us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625752.564057:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788625752.564203:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379def480 x1875509845733120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625752.564244:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845733120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788625753.339457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625753.749206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625753.749262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625753.749335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677696 00000100:00100000:1.0:1788625753.749346:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677696 00000100:00100000:1.0:1788625753.749394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:1.0:1788625753.749401:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2365:x1875509823677696:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625753.749451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2365:x1875509823677696:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625753.749456:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:0.0:1788625753.749651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677824 00000100:00100000:0.0:1788625753.749655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677824 00000100:00100000:0.0:1788625753.749699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1788625753.749707:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823677824:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625753.749758:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823677824:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 53us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625753.749763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00080000:1.0:1788625753.749806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625754.099483:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845733632:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.099638:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625754.099696:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625754.099702:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845733248:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.099771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625754.099797:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845733760:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.099823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625754.099852:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845733376:0@lo:400:kworker.0 00000100:00100000:0.0:1788625754.099869:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733760 00000100:00100000:1.0:1788625754.099876:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625754.099882:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733760 00000100:00100000:1.0:1788625754.099891:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845733888:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.099912:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625754.099929:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625754.099933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733376 00000100:00100000:1.0:1788625754.099934:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845733504:0@lo:400:kworker.0 00000100:00100000:0.0:1788625754.099936:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733376 00000100:00100000:1.0:1788625754.099953:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625754.099957:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625754.099965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.099977:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733632 00000100:00100000:1.0:1788625754.099980:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733632 00000100:00100000:1.0:1788625754.100006:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733888 00000100:00100000:1.0:1788625754.100014:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733888 00000100:00100000:0.0:1788625754.100031:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845733760:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625754.100036:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625754.100038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788625754.100042:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845733632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625754.100052:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733504 00000100:00100000:0.0:1788625754.100054:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733504 00000100:00100000:0.0:1788625754.100069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625754.100071:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845733632:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625754.100074:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845733376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.100077:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788625754.100091:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625754.100098:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845733888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625754.100123:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845733376:12345-0@lo:400:kworker.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625754.100127:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845733888:12345-0@lo:400:kworker.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625754.100130:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625754.100132:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625754.100142:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625754.100148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845733248 00000100:00100000:0.0:1788625754.100148:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.100151:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845733248 00000100:00100000:1.0:1788625754.100172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788625754.100173:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845733504:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625754.100178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845733248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625754.100179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625754.100205:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845733248:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625754.100212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:1.0:1788625754.100240:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625754.100245:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625754.100247:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625754.100309:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845733504:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.100321:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845733376:0@lo:400:kworker.0 00010000:00080000:1.0:1788625754.100333:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166df80 x1875509845733888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625754.100341:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845733888:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.100382:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845733248:0@lo:400:kworker.0 00000100:00100000:1.0:1788625754.100392:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845733760:0@lo:400:kworker.0 00010000:00080000:1.0:1788625754.100400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166d180 x1875509845733632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625754.100408:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845733632:0@lo:400:kworker.0 00010000:00010000:1.0:1788625754.354881:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625754.612958:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625754.612985:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845734016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625754.613061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625754.613151:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734016 00000100:00100000:0.0:1788625754.613159:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734016 00000100:00100000:0.0:1788625754.613206:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625754.613216:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845734016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625754.613265:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625754.613320:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845734016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625754.613328:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788625754.613369:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dece00 x1875509845734016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625754.613388:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845734016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625755.381541:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625756.406950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625757.077685:0:10134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:29:15 (1788625755) === 00010000:00010000:1.0:1788625757.427025:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625757.465139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625757.465288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823677952 00000100:00100000:0.0:1788625757.465298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823677952 00000100:00100000:0.0:1788625757.465357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:0.0:1788625757.465368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:8168:x1875509823677952:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625757.465384:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625757.465402:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798db200/0x8aede7274cb1377a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7caad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.465431:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798db200/0x8aede7274cb1377a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caad expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.465442:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798db200/0x8aede7274cb1377a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caad expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.465453:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db200, rc 0) 00000100:00100000:0.0:1788625757.465507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823677952:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 142us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.465514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:3.0:1788625757.467127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.467247:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678080 00000100:00100000:1.0:1788625757.467257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678080 00000100:00100000:1.0:1788625757.467308:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:1.0:1788625757.467318:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823678080:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788625757.467772:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823678080:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 452us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.467784:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:3.0:1788625757.472294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.472408:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678208 00000100:00100000:1.0:1788625757.472423:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678208 00000100:00100000:1.0:1788625757.472496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:1.0:1788625757.472507:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823678208:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788625757.472795:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823678208:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 289us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.472804:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:3.0:1788625757.493358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.493509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678336 00000100:00100000:1.0:1788625757.493525:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678336 00000100:00100000:1.0:1788625757.493627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:1.0:1788625757.493655:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8172:x1875509823678336:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625757.494343:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8172:x1875509823678336:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 665us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.494356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:3.0:1788625757.510949:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.511123:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678464 00000100:00100000:1.0:1788625757.511140:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678464 00000100:00100000:1.0:1788625757.511278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:1.0:1788625757.511289:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8172:x1875509823678464:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625757.511578:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8172:x1875509823678464:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 290us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.511587:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:3.0:1788625757.518205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.518310:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678592 00000100:00100000:1.0:1788625757.518321:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678592 00000100:00100000:1.0:1788625757.518380:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:1.0:1788625757.518390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+11:8168:x1875509823678592:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625757.518406:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625757.518424:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2200/0x8aede7274cb13781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cad7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625757.518453:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2200/0x8aede7274cb13781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cad7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625757.518465:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2200/0x8aede7274cb13781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cad7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625757.518475:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2200, rc 0) 00000100:00100000:1.0:1788625757.518547:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:8168:x1875509823678592:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 157us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.518554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:3.0:1788625757.527161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.527271:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678720 00000100:00100000:1.0:1788625757.527281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678720 00000100:00100000:1.0:1788625757.527333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:1.0:1788625757.527342:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:8168:x1875509823678720:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788625757.527364:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788625757.527386:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788625757.527390:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788625757.527393:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788625757.527396:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788625757.529571:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:8168:x1875509823678720:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 2221us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.529585:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:3.0:1788625757.536056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625757.537292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678848 00000100:00100000:0.0:1788625757.537319:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678848 00000100:00100000:0.0:1788625757.537432:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:0.0:1788625757.537444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:8168:x1875509823678848:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625757.537460:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625757.537478:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.537506:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.537518:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625757.537527:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da000, rc 0) 00000100:00100000:0.0:1788625757.537592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8168:x1875509823678848:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 151us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.537599:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:3.0:1788625757.542225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625757.546504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823678976 00000100:00100000:0.0:1788625757.546519:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823678976 00000100:00100000:0.0:1788625757.546584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:0.0:1788625757.546594:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8168:x1875509823678976:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625757.546902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8168:x1875509823678976:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 308us (4687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.546922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:3.0:1788625757.549136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625757.549209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679104 00000100:00100000:0.0:1788625757.549218:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679104 00000100:00100000:0.0:1788625757.549280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:0.0:1788625757.549292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8168:x1875509823679104:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788625757.549509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8168:x1875509823679104:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 218us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.549517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:3.0:1788625757.551064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.551376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679232 00000100:00100000:1.0:1788625757.551386:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679232 00000100:00100000:1.0:1788625757.551440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:1.0:1788625757.551450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8178:x1875509823679232:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625757.552182:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8178:x1875509823679232:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 729us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.552192:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:3.0:1788625757.553775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625757.554492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679360 00000100:00100000:2.0:1788625757.554503:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679360 00000100:00100000:2.0:1788625757.554563:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:2.0:1788625757.554573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8178:x1875509823679360:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625757.555162:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:8178:x1875509823679360:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 588us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625757.555171:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:3.0:1788625757.566368:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625757.566410:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625757.566458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.566558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679488 00000100:00100000:1.0:1788625757.566568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679488 00000100:00100000:1.0:1788625757.566615:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680000 00000100:00100000:1.0:1788625757.566619:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680000 00000100:00100000:1.0:1788625757.566666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:1.0:1788625757.566688:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823680000:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625757.566805:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823680000:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.566814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:3.0:1788625757.566929:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1788625757.566935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1875509823679488:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788625757.566960:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c41c9396-b2e6-4afd-9ccb-15f885c15f82@192.168.201.45@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:3.0:1788625757.566996:0:5841:0:(genops.c:1385:class_connect()) connect: client c41c9396-b2e6-4afd-9ccb-15f885c15f82, cookie 0x8aede7274cb1378f 00000004:00100000:3.0:1788625757.567024:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788625757.567287:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9b4347c01000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625757.567318:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2362:x1875509823679488:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 382us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625757.567326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00080000:1.0:1788625757.567388:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625757.567546:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679872 00000100:00100000:2.0:1788625757.567553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679872 00000100:00100000:2.0:1788625757.567590:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:2.0:1788625757.567597:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823679872:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625757.567637:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823679872:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625757.567643:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:3.0:1788625757.577306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625757.578546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.580505:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679744 00000100:00100000:1.0:1788625757.580520:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679744 00000100:00100000:1.0:1788625757.580616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823679616 00000100:00100000:1.0:1788625757.580619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823679616 00000100:00100000:1.0:1788625757.580645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625757.580655:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+7:8168:x1875509823679744:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625757.580700:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788625757.580856:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+7:8168:x1875509823679744:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 201us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.580864:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625757.580882:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1788625757.580889:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:0:x1875509823679616:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625757.580902:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788625757.580926:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:0:x1875509823679616:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 38us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.580932:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00080000:2.0:1788625757.581114:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625757.587970:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.588086:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680128 00000100:00100000:1.0:1788625757.588097:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680128 00000100:00100000:1.0:1788625757.588157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625757.588167:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:8168:x1875509823680128:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788625757.588276:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:8168:x1875509823680128:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.588297:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625757.591074:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.591315:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680256 00000100:00100000:1.0:1788625757.591325:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680256 00000100:00100000:1.0:1788625757.591374:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1788625757.591383:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875509823680256:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788625757.591416:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c41c9396-b2e6-4afd-9ccb-15f885c15f82@192.168.201.45@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:1.0:1788625757.591445:0:6697:0:(genops.c:1385:class_connect()) connect: client c41c9396-b2e6-4afd-9ccb-15f885c15f82, cookie 0x8aede7274cb13796 00002000:00100000:1.0:1788625757.591458:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c41c9396-b2e6-4afd-9ccb-15f885c15f82/ffff9b4379eef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625757.591481:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625757.591692:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788625757.591723:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b4379ee9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625757.592273:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2362:x1875509823680256:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 887us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.592282:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1788625757.593184:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625757.593286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625757.593706:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680384 00000100:00100000:1.0:1788625757.593716:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680384 00000100:00100000:1.0:1788625757.593782:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625757.593790:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875509823680384:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788625757.593818:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c41c9396-b2e6-4afd-9ccb-15f885c15f82@192.168.201.45@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:1.0:1788625757.593856:0:6698:0:(genops.c:1385:class_connect()) connect: client c41c9396-b2e6-4afd-9ccb-15f885c15f82, cookie 0x8aede7274cb1379d 00002000:00100000:1.0:1788625757.593867:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c41c9396-b2e6-4afd-9ccb-15f885c15f82/ffff9b4379eee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625757.593887:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625757.594119:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788625757.594146:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b4350f98000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625757.594216:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2362:x1875509823680384:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 425us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625757.594225:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1788625757.594960:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680512 00000100:00100000:0.0:1788625757.594967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680512 00000100:00100000:0.0:1788625757.595016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1788625757.595025:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:8168:x1875509823680512:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788625757.595099:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788625757.595171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:8168:x1875509823680512:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 146us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.595178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1788625757.683630:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625757.683654:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625757.683766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625757.683902:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734144 00000100:00100000:0.0:1788625757.683911:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734144 00000100:00100000:0.0:1788625757.683975:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625757.683985:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845734144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625757.684008:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788625757.684104:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625757.684170:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845734144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625757.684178:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788625757.684268:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dece00 x1875509845734144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625757.684303:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845734144:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788625758.263272:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00010000:00010000:1.0:1788625758.454281:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625759.223009:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845734656:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223130:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625759.223137:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845734272:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223164:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223186:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845734784:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223224:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223253:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845734528:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223309:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788625759.223315:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845734400:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223355:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845734912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.223404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734272 00000100:00100000:1.0:1788625759.223410:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734272 00000100:00100000:1.0:1788625759.223452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788625759.223461:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845734272:12345-0@lo:400:kworker.0 Request processed in 48us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788625759.223554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734784 00000100:00100000:1.0:1788625759.223557:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734784 00000100:00100000:1.0:1788625759.223588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734528 00000100:00100000:1.0:1788625759.223591:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734528 00000100:00100000:1.0:1788625759.223603:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734400 00000100:00100000:1.0:1788625759.223605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734400 00000100:00100000:1.0:1788625759.223617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625759.223623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223653:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845734784:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625759.223671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625759.223676:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845734528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223703:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845734528:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223709:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625759.223719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625759.223724:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845734400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223775:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845734400:12345-0@lo:400:kworker.0 Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223781:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625759.223798:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734656 00000100:00100000:1.0:1788625759.223801:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734656 00000100:00100000:1.0:1788625759.223823:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845734912 00000100:00100000:1.0:1788625759.223826:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845734912 00000100:00100000:1.0:1788625759.223843:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625759.223848:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845734656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223876:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845734656:12345-0@lo:400:kworker.0 Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223890:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625759.223901:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788625759.223907:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845734912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.223934:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845734912:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.223939:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788625759.223958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625759.223962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625759.223964:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625759.223994:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845734400:0@lo:400:kworker.0 00010000:00080000:1.0:1788625759.224007:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166df80 x1875509845734912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625759.224017:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845734912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.224027:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845734528:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.224053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845734272:0@lo:400:kworker.0 00000100:00100000:1.0:1788625759.224063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845734784:0@lo:400:kworker.0 00010000:00080000:1.0:1788625759.224073:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166c700 x1875509845734656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625759.224083:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845734656:0@lo:400:kworker.0 00010000:00010000:3.0:1788625759.487946:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625759.734277:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845735040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625759.734359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625759.739744:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735040 00000100:00100000:1.0:1788625759.739764:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735040 00000100:00100000:1.0:1788625759.739842:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625759.739855:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845735040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625759.739912:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625759.740003:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845735040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (5643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625759.740011:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788625759.757868:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cd9180 x1875509845735040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625759.757904:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845735040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625760.499345:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625761.523493:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788625762.371859:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000001:00100000:2.0:1788625762.405191:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00010000:00010000:2.0:1788625762.547390:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625762.749244:0:10331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788625762.805225:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625762.805250:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845735168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625762.805320:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625762.805533:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735168 00000100:00100000:1.0:1788625762.805542:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735168 00000100:00100000:1.0:1788625762.805600:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625762.805610:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845735168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625762.805645:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625762.805693:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845735168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625762.805700:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788625762.805766:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379c30a80 x1875509845735168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625762.805786:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845735168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625762.805859:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625762.966274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625762.966325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625762.966343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625762.966361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625762.966397:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625762.966657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680768 00000100:00100000:0.0:1788625762.966668:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680768 00000100:00100000:0.0:1788625762.966725:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680896 00000100:00100000:0.0:1788625762.966745:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680896 00000100:00100000:0.0:1788625762.966768:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:0.0:1788625762.966777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823680768:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625762.970985:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823680768:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 4194us (4706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625762.971000:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:0.0:1788625762.971039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:0.0:1788625762.971052:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823680896:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625762.971117:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823680896:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 70us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625762.971123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:0.0:1788625762.971501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823680640 00000100:00100000:0.0:1788625762.971511:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823680640 00000100:00100000:0.0:1788625762.971558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:0.0:1788625762.971565:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823680640:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625762.971597:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823680640:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (5272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625762.971603:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:0.0:1788625762.971643:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681152 00000100:00100000:0.0:1788625762.971654:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681152 00000100:00100000:0.0:1788625762.973131:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681024 00000100:00100000:0.0:1788625762.973150:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681024 00000100:00100000:2.0:1788625762.977289:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1788625762.977335:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823681152:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625762.977428:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823681152:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 127us (11065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625762.977437:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1788625762.977466:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1788625762.977474:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823681024:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625762.977501:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823681024:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (11103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625762.977508:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00080000:0.0:1788625762.978425:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625762.978433:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625762.978437:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788625763.571430:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625764.339803:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845735552:0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.339879:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625764.339947:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788625764.339953:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845735424:0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.339976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625764.339992:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845735936:0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.340012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625764.340046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735552 00000100:00100000:0.0:1788625764.340053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735552 00000100:00100000:0.0:1788625764.340102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735424 00000100:00100000:0.0:1788625764.340105:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735424 00000100:00100000:0.0:1788625764.340137:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625764.340146:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.340192:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845735552:12345-0@lo:400:kworker.0 Request processed in 47us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625764.340198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625764.340214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788625764.340220:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845735424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.340244:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845735424:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625764.340250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788625764.340270:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735936 00000100:00100000:0.0:1788625764.340287:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735936 00000100:00100000:0.0:1788625764.340316:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625764.340321:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845735936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.340351:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845735936:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625764.340358:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788625764.340372:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625764.340377:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625764.340415:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845735424:0@lo:400:kworker.0 00010000:00080000:0.0:1788625764.340429:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379def480 x1875509845735936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625764.340439:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845735936:0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.340447:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845735552:0@lo:400:kworker.0 00000100:00100000:2.0:1788625764.340610:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845735680:0@lo:400:kworker.0 00000100:00100000:2.0:1788625764.340641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625764.340672:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788625764.340679:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845735296:0@lo:400:kworker.0 00000100:00100000:2.0:1788625764.340705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625764.340725:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788625764.340770:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625764.340802:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735808 00000100:00100000:2.0:1788625764.340805:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735808 00000100:00100000:2.0:1788625764.340837:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625764.340843:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845735808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625764.340878:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845735808:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625764.340884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788625764.340901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625764.340917:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845735808:0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.341097:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735680 00000100:00100000:0.0:1788625764.341102:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735680 00000100:00100000:0.0:1788625764.341156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625764.341164:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625764.341200:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845735680:12345-0@lo:400:kworker.0 Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625764.341206:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625764.341387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845735296 00000100:00100000:1.0:1788625764.341392:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845735296 00000100:00100000:1.0:1788625764.341426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788625764.341433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845735296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625764.341478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845735296:12345-0@lo:400:kworker.0 Request processed in 46us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625764.341484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1788625764.341699:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625764.341757:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845735296:0@lo:400:kworker.0 00010000:00080000:2.0:1788625764.341774:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dee680 x1875509845735680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625764.341784:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845735680:0@lo:400:kworker.0 00010000:00010000:1.0:1788625764.606472:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625764.863880:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845736064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625764.863964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625764.864046:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736064 00000100:00100000:0.0:1788625764.864054:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736064 00000100:00100000:0.0:1788625764.864102:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625764.864122:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845736064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625764.864164:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625764.864210:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845736064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625764.864218:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788625764.864259:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43798e2d80 x1875509845736064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625764.864277:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845736064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625765.619896:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625766.644613:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625767.669497:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625767.934250:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625767.934271:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845736192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625767.934346:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625767.934419:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736192 00000100:00100000:3.0:1788625767.934427:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736192 00000100:00100000:3.0:1788625767.934485:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788625767.934496:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845736192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625767.934534:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625767.934591:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845736192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625767.934613:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788625767.934637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625767.934668:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4358380380 x1875509845736192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625767.934687:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845736192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625768.089610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625768.089657:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625768.089695:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625768.089724:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625768.089778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625768.089806:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681536 00000100:00100000:0.0:1788625768.089816:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681536 00000100:00100000:0.0:1788625768.089875:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681408 00000100:00100000:0.0:1788625768.089879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681408 00000100:00100000:0.0:1788625768.089902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1788625768.089912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681536:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625768.089919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:2.0:1788625768.089927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823681408:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625768.089982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681536:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625768.089990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:1.0:1788625768.089994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681280 00000100:00100000:1.0:1788625768.089997:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681280 00000100:00100000:0.0:1788625768.090013:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681792 00000100:00100000:0.0:1788625768.090015:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681792 00000100:00100000:1.0:1788625768.090024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:1.0:1788625768.090030:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823681280:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625768.090035:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681664 00000100:00100000:0.0:1788625768.090037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681664 00000100:00100000:3.0:1788625768.090111:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1788625768.090119:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681792:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625768.090170:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1788625768.090175:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681664:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625768.092121:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823681408:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 2185us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625768.092135:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00080000:2.0:1788625768.093850:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625768.093858:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625768.093862:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625768.096093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823681280:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 6048us (6480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625768.096109:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:2.0:1788625768.096382:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681792:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 6262us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625768.096392:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1788625768.096449:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823681664:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 6272us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625768.096457:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00010000:00010000:2.0:1788625768.694268:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625769.461107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845736448:0@lo:400:kworker.0 00000100:00100000:0.0:1788625769.461183:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625769.461238:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845736960:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.461348:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845736320:0@lo:400:kworker.0 00000100:00100000:2.0:1788625769.461397:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845736704:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.467653:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625769.467755:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845736832:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.467807:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625769.467874:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736320 00000100:00100000:3.0:1788625769.467883:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736320 00000100:00100000:3.0:1788625769.467943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788625769.467952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845736320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.468021:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845736320:12345-0@lo:400:kworker.0 Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625769.468040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788625769.468078:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736448 00000100:00100000:3.0:1788625769.468083:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736448 00000100:00100000:3.0:1788625769.468108:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736832 00000100:00100000:3.0:1788625769.468110:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736832 00000100:00100000:3.0:1788625769.468138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625769.468144:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845736448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.468179:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845736448:12345-0@lo:400:kworker.0 Request processed in 35us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625769.468199:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625769.468210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625769.468215:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845736832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.470461:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845736832:12345-0@lo:400:kworker.0 Request processed in 2234us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625769.470476:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788625769.470535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625769.470583:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845736320:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.470602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845736832:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.470673:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845736576:0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.470765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625769.470807:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736576 00000100:00100000:3.0:1788625769.470813:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736576 00000100:00100000:3.0:1788625769.470860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625769.470869:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845736576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625769.470921:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845736576:12345-0@lo:400:kworker.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625769.470928:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788625769.470943:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625769.470959:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845736576:0@lo:400:kworker.0 00000100:00100000:2.0:1788625769.471074:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625769.471118:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736704 00000100:00100000:2.0:1788625769.471122:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736704 00000100:00100000:2.0:1788625769.471210:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625769.471218:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845736704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625769.471280:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845736704:12345-0@lo:400:kworker.0 Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625769.471286:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788625769.471327:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625769.471347:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9d500 x1875509845736704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625769.471359:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845736704:0@lo:400:kworker.0 00000100:00100000:0.0:1788625769.472039:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625769.472092:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845736448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625769.472383:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845736960 00000100:00100000:2.0:1788625769.472389:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845736960 00000100:00100000:2.0:1788625769.472438:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788625769.472445:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625769.472491:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845736960:12345-0@lo:400:kworker.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625769.472497:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788625769.472523:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9ed80 x1875509845736960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625769.472533:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845736960:0@lo:400:kworker.0 00000100:00080000:0.0:1788625769.472575:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788625769.717210:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625769.971106:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845737088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625769.971219:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625769.973661:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737088 00000100:00100000:0.0:1788625769.973677:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737088 00000100:00100000:0.0:1788625769.973766:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625769.973778:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845737088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625769.974070:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625769.974154:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845737088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 379us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625769.974162:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788625769.974229:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9c000 x1875509845737088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625769.974280:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845737088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625770.750346:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625771.766228:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625772.786888:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625773.043911:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625773.043936:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845737216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625773.044399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625773.044905:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737216 00000100:00100000:2.0:1788625773.044915:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737216 00000100:00100000:2.0:1788625773.045055:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625773.045066:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845737216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625773.045293:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625773.045356:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845737216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 292us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625773.045364:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788625773.045409:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4358380e00 x1875509845737216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625773.045431:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845737216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625773.045578:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625773.218070:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625773.222479:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625773.222514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625773.222533:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625773.222562:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625773.222589:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682304 00000100:00100000:2.0:1788625773.222599:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682304 00000100:00100000:2.0:1788625773.222648:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682432 00000100:00100000:2.0:1788625773.222651:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682432 00000100:00100000:2.0:1788625773.222672:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625773.222683:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823682304:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625773.222777:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823682304:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625773.222785:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625773.222801:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1788625773.222808:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823682432:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625773.222832:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823682432:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625773.222838:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1788625773.222856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682048 00000100:00100000:2.0:1788625773.222859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682048 00000100:00100000:2.0:1788625773.222886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682176 00000100:00100000:2.0:1788625773.222889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682176 00000100:00100000:2.0:1788625773.222908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:2.0:1788625773.222915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823682048:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625773.222945:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823682048:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625773.222982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:2.0:1788625773.222996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:2.0:1788625773.223003:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823682176:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625773.223026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823682176:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625773.223031:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00080000:2.0:1788625773.223049:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625773.223053:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625773.223055:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625773.231174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823681920 00000100:00100000:1.0:1788625773.231192:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823681920 00000100:00100000:1.0:1788625773.233207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:1.0:1788625773.233221:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823681920:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625773.233299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823681920:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 81us (15238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625773.233308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00010000:00010000:2.0:1788625773.811075:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625774.579489:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845737600:0@lo:400:kworker.0 00000100:00100000:3.0:1788625774.579560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625774.579594:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845737344:0@lo:400:kworker.0 00000100:00100000:3.0:1788625774.579618:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788625774.579624:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4358383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845737472:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.579629:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625774.579644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625774.579654:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845737856:0@lo:400:kworker.0 00000100:00100000:3.0:1788625774.579658:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845737984:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.579673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625774.579677:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625774.580144:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625774.580154:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845737728:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580182:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625774.580213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737344 00000100:00100000:1.0:1788625774.580220:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737344 00000100:00100000:1.0:1788625774.580260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788625774.580269:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845737344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845737344:12345-0@lo:400:kworker.0 Request processed in 55us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.580332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788625774.580364:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737600 00000100:00100000:1.0:1788625774.580368:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737600 00000100:00100000:1.0:1788625774.580400:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737472 00000100:00100000:1.0:1788625774.580403:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737472 00000100:00100000:1.0:1788625774.580415:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737856 00000100:00100000:1.0:1788625774.580417:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737856 00000100:00100000:1.0:1788625774.580432:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625774.580438:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845737600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580474:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845737600:12345-0@lo:400:kworker.0 Request processed in 35us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.580481:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625774.580492:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788625774.580498:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845737472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580524:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845737472:12345-0@lo:400:kworker.0 Request processed in 26us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.580530:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788625774.580540:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788625774.580546:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845737856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580572:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845737856:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.580577:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788625774.580607:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737984 00000100:00100000:1.0:1788625774.580611:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737984 00000100:00100000:1.0:1788625774.580637:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845737728 00000100:00100000:1.0:1788625774.580646:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845737728 00000100:00100000:1.0:1788625774.580668:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625774.580674:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845737984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.580831:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845737984:12345-0@lo:400:kworker.0 Request processed in 157us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.580839:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625774.580852:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625774.580857:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845737728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.581188:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845737728:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625774.581198:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788625774.581220:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625774.581224:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625774.581255:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845737472:0@lo:400:kworker.0 00010000:00080000:1.0:1788625774.581268:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379dedf80 x1875509845737984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625774.581277:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845737984:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.581286:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845737600:0@lo:400:kworker.0 00010000:00080000:1.0:1788625774.581325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379def480 x1875509845737728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625774.581333:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845737728:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.581341:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4358381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845737344:0@lo:400:kworker.0 00000100:00100000:1.0:1788625774.581350:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845737856:0@lo:400:kworker.0 00010000:00010000:3.0:1788625774.836627:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625775.091694:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845738112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625775.091832:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625775.091980:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738112 00000100:00100000:0.0:1788625775.091989:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738112 00000100:00100000:0.0:1788625775.092218:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625775.092230:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845738112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625775.092283:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625775.092341:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845738112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625775.092348:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788625775.092469:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9d880 x1875509845738112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625775.092489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845738112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625775.864568:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625776.882938:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625777.907319:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625778.163026:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845738240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625778.163136:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625778.163244:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738240 00000100:00100000:2.0:1788625778.163254:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738240 00000100:00100000:2.0:1788625778.163324:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625778.163337:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845738240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625778.163384:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625778.163437:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845738240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625778.163446:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788625778.163471:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625778.163511:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379c32680 x1875509845738240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625778.163533:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845738240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625778.344519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625778.344586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625778.344613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625778.344639:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625778.344669:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625778.344725:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682816 00000100:00100000:2.0:1788625778.344761:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682816 00000100:00100000:2.0:1788625778.344835:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682688 00000100:00100000:2.0:1788625778.344838:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682688 00000100:00100000:2.0:1788625778.344863:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:2.0:1788625778.344874:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823682816:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625778.344991:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823682816:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625778.345000:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:2.0:1788625778.345251:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1788625778.345259:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823682688:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625778.345291:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823682688:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625778.345298:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1788625778.345324:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682944 00000100:00100000:2.0:1788625778.345328:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682944 00000100:00100000:2.0:1788625778.345358:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683072 00000100:00100000:2.0:1788625778.345362:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683072 00000100:00100000:2.0:1788625778.345385:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625778.345392:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2362:x1875509823682944:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1788625778.345421:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13796 00000100:00080000:2.0:1788625778.345450:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9b4379ee9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625778.345508:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788625778.347532:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788625778.348614:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625778.348625:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625778.348630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625778.348668:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1788625778.348698:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2362:x1875509823683072:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1788625778.348763:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1379d 00000100:00080000:3.0:1788625778.348776:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b4350f98000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625778.348842:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788625778.349509:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+2:2362:x1875509823683072:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 815us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625778.349540:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:3.0:1788625778.349582:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625778.352348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823682560 00000100:00100000:0.0:1788625778.352370:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823682560 00000100:00100000:0.0:1788625778.352461:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:0.0:1788625778.352475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823682560:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625778.352588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823682560:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 115us (8597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625778.352596:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:2.0:1788625778.357807:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+2:2362:x1875509823682944:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 12396us (13148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625778.357827:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00010000:00010000:3.0:1788625778.931010:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625779.699523:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845738496:0@lo:400:kworker.0 00000100:00100000:2.0:1788625779.699526:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845738368:0@lo:400:kworker.0 00000100:00100000:3.0:1788625779.699638:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845738752:0@lo:400:kworker.0 00000100:00100000:0.0:1788625779.701054:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845738624:0@lo:400:kworker.0 00000100:00100000:2.0:1788625779.702063:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625779.702256:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845738880:0@lo:400:kworker.0 00000100:00100000:2.0:1788625779.702308:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625779.702402:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625779.702426:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738880 00000100:00100000:2.0:1788625779.702439:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738880 00000100:00100000:2.0:1788625779.702630:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625779.702643:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625779.702675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625779.702711:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845739008:0@lo:400:kworker.0 00000100:00100000:1.0:1788625779.702780:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625779.702841:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738368 00000100:00100000:2.0:1788625779.702847:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845738880:12345-0@lo:400:kworker.0 Request processed in 204us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625779.702862:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738368 00000100:00100000:2.0:1788625779.702876:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625779.702904:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738496 00000100:00100000:2.0:1788625779.702909:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738496 00000100:00100000:1.0:1788625779.702941:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788625779.702952:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625779.702960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845738368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625779.702970:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845738496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625779.703022:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845738496:12345-0@lo:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625779.703028:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625779.703191:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845738880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625779.703241:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738752 00000100:00100000:3.0:1788625779.703251:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738752 00000100:00100000:3.0:1788625779.703302:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739008 00000100:00100000:3.0:1788625779.703306:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739008 00000100:00100000:3.0:1788625779.703333:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625779.703341:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845738752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625779.703395:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845738752:12345-0@lo:400:kworker.0 Request processed in 55us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625779.703403:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625779.703419:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788625779.703425:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845739008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625779.703455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845739008:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625779.703461:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788625779.703479:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625779.703483:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625779.703723:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845738368:12345-0@lo:400:kworker.0 Request processed in 770us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625779.703887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788625779.703949:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845738368:0@lo:400:kworker.0 00000100:00100000:1.0:1788625779.703992:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845738496:0@lo:400:kworker.0 00010000:00080000:1.0:1788625779.704010:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cd9500 x1875509845739008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625779.704022:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845739008:0@lo:400:kworker.0 00000100:00100000:0.0:1788625779.704062:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625779.704680:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845738624 00000100:00100000:2.0:1788625779.704692:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845738624 00000100:00100000:2.0:1788625779.704818:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788625779.704833:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845738624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788625779.704867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625779.704942:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845738624:12345-0@lo:400:kworker.0 Request processed in 115us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625779.704952:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788625779.705299:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845738624:0@lo:400:kworker.0 00010000:00080000:0.0:1788625779.705601:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cdb480 x1875509845738752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625779.705616:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845738752:0@lo:400:kworker.0 00010000:00010000:3.0:1788625779.956651:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625780.211418:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625780.211446:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845739136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625780.211528:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625780.211828:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739136 00000100:00100000:0.0:1788625780.211838:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739136 00000100:00100000:0.0:1788625780.211925:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625780.211935:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845739136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625780.211974:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625780.212040:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845739136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625780.212046:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788625780.212170:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9fb80 x1875509845739136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625780.212189:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845739136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625780.978998:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625781.785399:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788625782.003375:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788625782.854390:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000020:00000080:3.0:1788625782.854410:0:7653:0:(genops.c:885:class_export_put()) final put ffff9b4379eee800/c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000020:00000080:3.0:1788625782.854447:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4379eee800/c41c9396-b2e6-4afd-9ccb-15f885c15f82 for lustre-OST0001 00000020:00000080:3.0:1788625782.854498:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4350f98000 for lustre-OST0001 00000001:00100000:1.0:1788625782.897213:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000020:00000080:1.0:1788625782.897224:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b4379eef000/c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000020:00000080:1.0:1788625782.897255:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4379eef000/c41c9396-b2e6-4afd-9ccb-15f885c15f82 for lustre-OST0000 00000020:00000080:1.0:1788625782.897313:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4379ee9000 for lustre-OST0000 00010000:00010000:2.0:1788625783.027279:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625783.283293:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845739264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625783.283358:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625783.283547:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739264 00000100:00100000:2.0:1788625783.283555:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739264 00000100:00080000:1.0:1788625783.283667:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625783.283714:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788625783.283724:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845739264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625783.283786:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625783.283838:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845739264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625783.283844:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788625783.283914:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379c30700 x1875509845739264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625783.283933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845739264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625783.449891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625783.449931:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625783.449964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625783.450027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683200 00000100:00100000:1.0:1788625783.450038:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683200 00000100:00100000:1.0:1788625783.450094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:1.0:1788625783.450105:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823683200:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625783.450131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683328 00000100:00100000:2.0:1788625783.450135:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683328 00000100:00100000:1.0:1788625783.450171:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823683200:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625783.450178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00080000:1.0:1788625783.450206:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625783.450596:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683456 00000100:00100000:2.0:1788625783.450601:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683456 00000100:00100000:1.0:1788625783.450614:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:1.0:1788625783.450931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823683328:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625783.450961:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:2.0:1788625783.450968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823683456:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:0.0:1788625783.451258:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625783.451285:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823683328:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 663us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625783.451290:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:2.0:1788625783.451322:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823683456:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 355us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625783.451327:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00010000:00010000:3.0:1788625784.051043:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625784.822886:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845739520:0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.822957:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625784.823025:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845740032:0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.823053:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625784.823082:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625784.823087:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.823108:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625784.823145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739520 00000100:00100000:1.0:1788625784.823153:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739520 00000100:00100000:1.0:1788625784.823196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739648 00000100:00100000:1.0:1788625784.823199:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739648 00000100:00100000:1.0:1788625784.823246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625784.823255:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845739520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.823306:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845739520:12345-0@lo:400:kworker.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625784.823313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625784.823329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788625784.823336:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.823361:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845739648:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625784.823367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788625784.823388:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625784.823538:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.823549:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845739520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.823638:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845739392:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.823673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625784.823708:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.823755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625784.823855:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625784.823862:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845739776:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.823889:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625784.824125:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740032 00000100:00100000:3.0:1788625784.824131:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740032 00000100:00100000:1.0:1788625784.828029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739392 00000100:00100000:1.0:1788625784.828050:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739392 00000100:00100000:1.0:1788625784.828116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788625784.828128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845739392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.828262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845739392:12345-0@lo:400:kworker.0 Request processed in 136us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625784.828270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1788625784.828317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625784.828493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739904 00000100:00100000:1.0:1788625784.828498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739904 00000100:00100000:1.0:1788625784.828540:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788625784.828546:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845739904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625784.828582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845739904:12345-0@lo:400:kworker.0 Request processed in 37us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625784.828588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788625784.828602:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625784.831998:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845739392:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.832019:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788625784.832067:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845739776 00000100:00100000:3.0:1788625784.832073:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845739776 00000100:00100000:0.0:1788625784.832232:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625784.832253:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845740032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625784.832344:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845740032:12345-0@lo:400:kworker.0 Request processed in 103us (9290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625784.832352:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788625784.832359:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cda680 x1875509845740032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625784.832368:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788625784.832372:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845740032:0@lo:400:kworker.0 00000100:00100000:0.0:1788625784.832374:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845739776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625784.832419:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845739776:12345-0@lo:400:kworker.0 Request processed in 37us (8521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625784.832425:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788625784.832429:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cd8a80 x1875509845739776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625784.832439:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845739776:0@lo:400:kworker.0 00010000:00010000:2.0:1788625785.077825:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625785.331940:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625785.331965:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845740160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625785.332034:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625785.332308:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740160 00000100:00100000:0.0:1788625785.332316:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740160 00000100:00100000:0.0:1788625785.332365:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625785.332375:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845740160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625785.332409:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625785.332454:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845740160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625785.332473:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788625785.332548:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9e300 x1875509845740160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625785.332639:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845740160:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788625785.743111:0:11181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea02f0880 20000000:00000080:1.0:1788625785.743137:0:11181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b434355c000 uarg=0000000000000000 20000000:01000000:1.0:1788625785.743178:0:11181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625785.743184:0:11181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625785.743189:0:11181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788625785.744868:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788625785.745156:0:11181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788625785.757430:0:11181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625785.757965:0:11181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.757990:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758000:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13750 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758008:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1375e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758015:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1376c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758022:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758029:0:11181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758076:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758091:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 12 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625785.758107:0:11181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740288:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625785.758210:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758230:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 18 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625785.758240:0:11181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740416:0@lo:104: 00000100:00100000:0.0:1788625785.758281:0:11181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625785.758321:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758330:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 18 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625785.758340:0:11181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740544:0@lo:104: 00000100:00100000:0.0:1788625785.758361:0:11181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625785.758362:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740416 00000100:00100000:2.0:1788625785.758369:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740416 00010000:00010000:0.0:1788625785.758398:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758406:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 18 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625785.758414:0:11181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740672:0@lo:104: 00000100:00100000:2.0:1788625785.758425:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740544 00000100:00100000:2.0:1788625785.758429:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740544 00000100:00100000:0.0:1788625785.758434:0:11181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625785.758439:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740672 00000100:00100000:2.0:1788625785.758441:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740672 00010000:00010000:0.0:1788625785.758449:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.758458:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.758466:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625785.758466:0:11181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740800:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625785.758482:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:11181:x1875509845740416:12345-0@lo:104: 00010000:00010000:2.0:1788625785.758495:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625785.758498:0:11181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf840 going to sleep for 11 seconds 00010000:00010000:2.0:1788625785.758548:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625785.758554:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:11181:x1875509845740416:12345-0@lo:104: Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.758561:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625785.758566:0:11181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740416:0@lo:104: 00000100:00100000:2.0:1788625785.758577:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625785.758582:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:11181:x1875509845740544:12345-0@lo:104: 00010000:00010000:2.0:1788625785.758590:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758633:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625785.758638:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:11181:x1875509845740544:12345-0@lo:104: Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.758644:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625785.758655:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625785.758661:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:11181:x1875509845740672:12345-0@lo:104: 00010000:00010000:2.0:1788625785.758668:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758701:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788625785.758712:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:11181:x1875509845740672:12345-0@lo:104: Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.758717:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788625785.758770:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625785.758777:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758784:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625785.758789:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758796:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625785.758802:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625785.758808:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625785.758834:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758841:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625785.758860:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758866:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6000/0x8aede7274cb1376c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13773 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758879:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625785.758882:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758897:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625785.758900:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.758907:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625785.758913:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625785.758918:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788625785.759416:0:11181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740544:0@lo:104: 00000100:00100000:0.0:1788625785.759426:0:11181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740672:0@lo:104: 00010000:00010000:2.0:1788625785.759643:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759650:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625785.759659:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759664:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb1375e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13765 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759675:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625785.759678:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759684:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625785.759687:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759706:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625785.759713:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625785.759717:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625785.759838:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625785.759845:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625785.759891:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.759898:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788625785.760017:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845741184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625785.760065:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625785.760201:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760210:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371016000/0x8aede7274cb13750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb13757 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760224:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625785.760226:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625785.760227:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625785.760238:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845740928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625785.760280:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625785.760311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625785.760317:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845741056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625785.760337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625785.760371:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741184 00000100:00100000:2.0:1788625785.760377:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741184 00010000:00010000:2.0:1788625785.760402:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 19 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.760438:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845740928 00000100:00100000:2.0:1788625785.760441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845740928 00010000:00010000:2.0:1788625785.760453:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 20 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.760463:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741056 00000100:00100000:2.0:1788625785.760465:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741056 00010000:00010000:2.0:1788625785.760488:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 21 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.760503:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625785.760512:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+21:3310:x1875509845741184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625785.760523:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625785.760528:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 21 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760537:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 21 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760552:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2400/0x8aede7274cb13757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb13750 expref: 21 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760566:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625785.760597:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3310:x1875509845741184:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.760604:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625785.760649:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625785.760655:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845740928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625785.760670:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625785.760674:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 19 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760681:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 19 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760690:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f6600/0x8aede7274cb13773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1376c expref: 19 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760700:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625785.760726:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3308:x1875509845740928:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.760770:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625785.760783:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625785.760790:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3308:x1875509845741056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625785.760796:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625785.760801:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 17 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760809:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 17 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760818:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7800/0x8aede7274cb13765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1375e expref: 17 pid: 5835 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.760827:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625785.760849:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845741056:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.760863:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625785.760898:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845741056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625785.760905:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845740928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625785.761190:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845741184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625785.766971:0:11181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740288:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625785.766990:0:11181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1875509845740800:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625785.767043:0:11181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625785.774825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625785.774908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625785.775122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683584 00000100:00100000:2.0:1788625785.775132:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683584 00010000:00010000:2.0:1788625785.775173:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 13 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.775211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683712 00000100:00100000:2.0:1788625785.775214:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683712 00010000:00010000:2.0:1788625785.775228:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 14 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625785.775248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1788625785.775259:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+14:2365:x1875509823683584:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625785.775277:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625785.775283:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 14 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775297:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 14 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775317:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798da000/0x8aede7274cb13788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cade expref: 14 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775338:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625785.775411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823683584:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 153us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.775418:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1788625785.775438:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1788625785.775445:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:2365:x1875509823683712:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625785.775454:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625785.775459:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775469:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775480:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371017e00/0x8aede7274cb13749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caa6 expref: 12 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775492:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775501:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775519:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775527:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775535:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775542:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775556:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798daa00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625785.775560:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775570:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775582:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625785.775593:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625785.775613:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+11:2365:x1875509823683712:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 168us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625785.775620:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00010000:00010000:0.0:1788625785.775801:0:11181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.775811:0:11181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625785.775818:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798daa00/0x8aede7274cb137a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625786.098966:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625787.123910:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788625787.379544:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625787.379552:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437fc51000 from 7 10000000:01000000:3.0:1788625787.379558:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625787.379613:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.379626:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.379651:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625787.379678:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.379804:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.379850:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348f4e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625787.381070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741312 00000100:00100000:0.0:1788625787.381081:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741312 00000100:00100000:0.0:1788625787.381166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788625787.381176:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845741312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625787.381189:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625787.381206:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb137ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.381249:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb137ab expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.381260:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137ab expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.381270:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da000, rc 0) 00000100:00100000:0.0:1788625787.381324:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625787.381332:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788625787.381445:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625787.381460:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.381469:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625787.381525:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625787.381552:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625787.381622:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.381785:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741440 00000100:00100000:1.0:1788625787.381790:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741440 00000100:00100000:1.0:1788625787.381979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788625787.381987:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625787.382209:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.382216:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788625787.382289:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.382324:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.382364:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.382395:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348f4e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625787.382406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741568 00000100:00100000:0.0:1788625787.382411:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741568 00000100:00100000:0.0:1788625787.382438:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788625787.382444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625787.382578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625787.383210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788625787.384359:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625787.386145:0:11232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788625787.386322:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788625787.386343:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625787.386355:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.386368:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625787.386378:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625787.386381:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4377f6e800 from 7 10000000:01000000:3.0:1788625787.386384:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625787.386421:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.386429:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.386449:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625787.386483:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.386546:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.386587:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.386692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741696 00000100:00100000:1.0:1788625787.386700:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741696 00000100:00100000:1.0:1788625787.386787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788625787.386797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845741696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625787.386919:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625787.386933:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb137b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.386957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.387094:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.387120:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3600, rc 0) 00000100:00100000:1.0:1788625787.387168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845741696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 372us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.387173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788625787.387866:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625787.387885:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.387894:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625787.387953:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.387987:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625787.388047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741824 00000100:00100000:1.0:1788625787.388054:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741824 00000100:00100000:1.0:1788625787.388093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788625787.388101:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845741824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625787.388317:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845741824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.388325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788625787.389334:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625787.389360:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.389402:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.389455:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.389493:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.389502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845741952 00000100:00100000:1.0:1788625787.389509:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845741952 00000100:00100000:1.0:1788625787.389551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788625787.389560:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845741952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625787.389997:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845741952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 436us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.390005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788625787.390091:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845741952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625787.392116:0:11233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788625787.393060:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788625787.393082:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625787.393094:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.393111:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625787.393120:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625787.393123:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346652800 from 7 10000000:01000000:3.0:1788625787.393125:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625787.393672:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.393684:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.393694:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625787.393749:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.393807:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.393845:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.394763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742080 00000100:00100000:1.0:1788625787.394772:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742080 00000100:00100000:1.0:1788625787.394899:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788625787.394911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845742080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625787.394926:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625787.394942:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb137c7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.395049:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.395062:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.395071:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2400, rc 0) 00000100:00100000:1.0:1788625787.395126:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845742080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.395133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788625787.395612:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625787.395629:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625787.395639:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625787.395700:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.395765:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.395799:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.395910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742208 00000100:00100000:1.0:1788625787.395916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742208 00000100:00100000:1.0:1788625787.395952:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788625787.395960:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845742208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625787.396816:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845742208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 846us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.396826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788625787.399988:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.400058:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.400128:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625787.400172:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625787.400238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742336 00000100:00100000:1.0:1788625787.400244:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742336 00000100:00100000:1.0:1788625787.400298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788625787.400307:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845742336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625787.400478:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845742336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.400485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788625787.400578:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437971a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845742336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625787.402278:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788625787.402330:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788625787.402355:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625787.402367:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.402378:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625787.741927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625787.742063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683840 00000100:00100000:0.0:1788625787.742072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683840 00000100:00100000:0.0:1788625787.742124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 245 00000100:00100000:0.0:1788625787.742134:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:5606:x1875509823683840:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625787.742150:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625787.742170:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb08 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.742197:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.742209:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625787.742219:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da600, rc 0) 00000100:00100000:0.0:1788625787.742272:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823683840:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625787.742278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 245 00000100:00100000:3.0:1788625787.749001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625787.750509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823683968 00000100:00100000:0.0:1788625787.750522:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823683968 00000100:00100000:0.0:1788625787.750584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:0.0:1788625787.750594:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823683968:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625787.750929:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823683968:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 335us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625787.750938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:1.0:1788625787.758225:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625787.758463:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684096 00000100:00100000:2.0:1788625787.758473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684096 00000100:00100000:2.0:1788625787.758536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 247 00000100:00100000:2.0:1788625787.758546:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823684096:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625787.758812:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823684096:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 266us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625787.758820:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 247 00000100:00100000:0.0:1788625787.773145:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625787.774236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684224 00000100:00100000:1.0:1788625787.774248:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684224 00000100:00100000:1.0:1788625787.774302:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00100000:1.0:1788625787.774312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823684224:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625787.774329:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625787.774346:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.774374:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.774386:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625787.774396:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3c00, rc 0) 00000100:00100000:1.0:1788625787.774455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823684224:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 144us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625787.774462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00100000:2.0:1788625787.782929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625787.783013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684352 00000100:00100000:0.0:1788625787.783024:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684352 00000100:00100000:0.0:1788625787.783078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 249 00000100:00100000:0.0:1788625787.783087:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823684352:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625787.783364:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823684352:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 277us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625787.783372:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 249 00000100:00100000:0.0:1788625787.801134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625787.802077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684480 00000100:00100000:3.0:1788625787.802088:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684480 00000100:00100000:3.0:1788625787.802136:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 250 00000100:00100000:3.0:1788625787.802146:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823684480:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625787.802352:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823684480:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 206us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625787.802360:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 250 00010000:00010000:1.0:1788625788.147434:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625788.406210:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625788.406231:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845742464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625788.406299:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625788.406382:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742464 00000100:00100000:2.0:1788625788.406390:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742464 00000100:00100000:2.0:1788625788.406441:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625788.406450:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845742464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625788.406575:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625788.406619:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845742464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625788.406626:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788625788.406643:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625788.406670:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4351618380 x1875509845742464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625788.406690:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845742464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625788.567635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625788.567679:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625788.567748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625788.567775:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684608 00000100:00100000:0.0:1788625788.567784:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684608 00000100:00100000:0.0:1788625788.567833:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:0.0:1788625788.567843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823684608:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625788.567910:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823684608:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 68us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625788.567917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:1.0:1788625788.568223:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684736 00000100:00100000:1.0:1788625788.568228:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684736 00000100:00100000:1.0:1788625788.568280:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684864 00000100:00100000:1.0:1788625788.568283:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684864 00000100:00100000:1.0:1788625788.568303:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:1.0:1788625788.568310:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823684736:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625788.568347:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823684736:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625788.568353:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:1.0:1788625788.568365:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:1.0:1788625788.568371:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823684864:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625788.568393:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823684864:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 21us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625788.568398:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00080000:0.0:1788625788.568637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625789.171036:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625789.942141:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845742720:0@lo:400:kworker.0 00000100:00100000:2.0:1788625789.942211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625789.942411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845742592:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.944993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625789.945057:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845743104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.945093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625789.945148:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742592 00000100:00100000:3.0:1788625789.945156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742592 00000100:00100000:3.0:1788625789.945200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788625789.945208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845742592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.945600:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845742592:12345-0@lo:400:kworker.0 Request processed in 391us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625789.945607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788625789.945650:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742720 00000100:00100000:3.0:1788625789.945654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742720 00000100:00100000:3.0:1788625789.945690:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743104 00000100:00100000:3.0:1788625789.945693:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743104 00000100:00100000:3.0:1788625789.946141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788625789.946148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845742720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.946187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845742720:12345-0@lo:400:kworker.0 Request processed in 40us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625789.946194:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788625789.946206:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788625789.946212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845743104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.946365:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845743104:12345-0@lo:400:kworker.0 Request processed in 152us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625789.946371:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788625789.946395:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625789.946424:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845742592:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.946613:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845743104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.946662:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845742976:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.947617:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625789.947657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625789.947665:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845742848:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.947785:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625789.947891:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742976 00000100:00100000:3.0:1788625789.947899:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742976 00000100:00100000:3.0:1788625789.947940:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788625789.947948:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845742976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.948081:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845742976:12345-0@lo:400:kworker.0 Request processed in 134us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625789.948088:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788625789.948126:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435161b800 x1875509845742976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625789.948137:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845742976:0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.948158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845742848 00000100:00100000:3.0:1788625789.948162:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845742848 00000100:00100000:3.0:1788625789.948193:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788625789.948199:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845742848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625789.949048:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845742848:12345-0@lo:400:kworker.0 Request processed in 846us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625789.949058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788625789.949083:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625789.949107:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845742848:0@lo:400:kworker.0 00000100:00100000:2.0:1788625789.952622:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845742720:0@lo:400:kworker.0 00000100:00100000:2.0:1788625789.952639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845743232:0@lo:400:kworker.0 00000100:00100000:2.0:1788625789.952746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625789.952791:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743232 00000100:00100000:2.0:1788625789.952798:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743232 00000100:00100000:2.0:1788625789.953075:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625789.953085:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845743232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625789.953137:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845743232:12345-0@lo:400:kworker.0 Request processed in 54us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625789.953145:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788625789.953170:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788625789.953189:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4351618e00 x1875509845743232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625789.953208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845743232:0@lo:400:kworker.0 00010000:00010000:1.0:1788625790.196103:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625790.450936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625790.450956:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845743360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625790.451036:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625790.451326:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743360 00000100:00100000:2.0:1788625790.451349:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743360 00000100:00100000:2.0:1788625790.451400:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625790.451410:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845743360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625790.451454:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625790.451503:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845743360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625790.451510:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788625790.451620:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4347cdaa00 x1875509845743360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625790.451638:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845743360:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788625790.505381:0:11379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788625791.219008:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625792.242908:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625793.267063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625793.523133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625793.523202:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625793.523328:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743488 00000100:00100000:3.0:1788625793.523336:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743488 00000100:00100000:3.0:1788625793.523397:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625793.523408:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845743488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625793.523458:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788625793.523671:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625793.526182:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845743488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2767us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625793.526198:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788625793.526288:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4351618e00 x1875509845743488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625793.526314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625793.686185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625793.686235:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625793.686269:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625793.686388:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685248 00000100:00100000:2.0:1788625793.686399:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685248 00000100:00100000:2.0:1788625793.686470:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685120 00000100:00100000:2.0:1788625793.686474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685120 00000100:00100000:2.0:1788625793.686497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1788625793.686507:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823685248:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625793.686582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823685248:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625793.686589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1788625793.686606:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:2.0:1788625793.686648:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823685120:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625793.686689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823685120:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 43us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625793.686706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00080000:1.0:1788625793.687213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625793.687389:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823684992 00000100:00100000:0.0:1788625793.687397:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823684992 00000100:00100000:0.0:1788625793.687448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 253 00000100:00100000:0.0:1788625793.687457:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823684992:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625793.687506:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823684992:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 50us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625793.687525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 253 00010000:00010000:3.0:1788625794.295244:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625794.781677:0:11480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:29:53 (1788625793) === 00000100:00100000:1.0:1788625795.021454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.021500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.021965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685376 00000100:00100000:3.0:1788625795.021995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685376 00000100:00080000:1.0:1788625795.022163:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625795.022171:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685504 00000100:00100000:2.0:1788625795.022176:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685504 00000100:00100000:3.0:1788625795.022213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625795.022213:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625795.022224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823685376:12345-192.168.201.45@tcp:41:mkdir.0 00000100:00100000:2.0:1788625795.022224:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9725:x1875509823685504:12345-192.168.201.45@tcp:700:mkdir.0 00000100:00100000:2.0:1788625795.022301:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9725:x1875509823685504:12345-192.168.201.45@tcp:700:mkdir.0 Request processed in 78us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625795.022308:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000004:00000024:3.0:1788625795.022415:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788625795.022557:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823685376:12345-192.168.201.45@tcp:41:mkdir.0 Request processed in 336us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625795.022565:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1788625795.044415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.051039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685760 00000100:00100000:1.0:1788625795.051052:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685760 00000100:00100000:0.0:1788625795.051282:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:0.0:1788625795.051295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:9725:x1875509823685760:12345-192.168.201.45@tcp:36:mkdir.0 00010000:00010000:0.0:1788625795.051352:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625795.051382:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb136c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca91 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051406:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f800) 00010000:00010000:0.0:1788625795.051416:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625795.051798:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051823:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051867:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051875:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.051881:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625795.053025:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788625795.053042:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053050:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053057:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053062:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625795.053066:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053074:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053086:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917be00) 00010000:00010000:0.0:1788625795.053089:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625795.053093:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.053099:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb137e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625795.053116:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007799f779 reply state 00000000f5ae42de transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625795.053124:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625795.053221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9725:x1875509823685760:12345-192.168.201.45@tcp:36:mkdir.0 Request processed in 1926us (8814us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788625795.053229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:2.0:1788625795.056706:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056750:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056759:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056765:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.056770:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056776:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056792:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b435917bb00) 00010000:00010000:2.0:1788625795.056794:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.056809:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.056813:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb137ea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625795.062263:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845743744:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.062337:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625795.062463:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845744256:0@lo:400:kworker.0 00000100:00100000:3.0:1788625795.062481:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845743616:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.062496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625795.062557:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744256 00000100:00100000:2.0:1788625795.062566:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744256 00000100:00100000:3.0:1788625795.062573:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625795.062651:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845744128:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.062685:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625795.062696:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625795.062707:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625795.062762:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845743872:0@lo:400:kworker.0 00000100:00100000:1.0:1788625795.062806:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845744000:0@lo:400:kworker.0 00000100:00100000:1.0:1788625795.062832:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625795.062874:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744000 00000100:00100000:1.0:1788625795.062878:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744000 00000100:00100000:1.0:1788625795.062906:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625795.062913:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845744000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625795.062974:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845744000:12345-0@lo:400:kworker.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.062981:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788625795.063001:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625795.063004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788625795.063022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9d500 x1875509845744000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625795.063032:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845744000:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.063140:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845744256:12345-0@lo:400:kworker.0 Request processed in 439us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625795.063146:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788625795.063172:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4342c9d880 x1875509845744256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625795.063179:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845744256:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.065809:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743616 00000100:00100000:2.0:1788625795.065825:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743616 00000100:00100000:2.0:1788625795.065888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788625795.065898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845743616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.065983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845743616:12345-0@lo:400:kworker.0 Request processed in 86us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625795.065990:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788625795.067032:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743744 00000100:00100000:0.0:1788625795.067046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743744 00000100:00100000:3.0:1788625795.067077:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845743616:0@lo:400:kworker.0 00000100:00100000:0.0:1788625795.067084:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744128 00000100:00100000:0.0:1788625795.067090:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744128 00000100:00100000:0.0:1788625795.067133:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625795.067143:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625795.067201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845743744:12345-0@lo:400:kworker.0 Request processed in 61us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625795.067206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625795.067217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788625795.067221:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845744128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625795.067241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845744128:12345-0@lo:400:kworker.0 Request processed in 20us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625795.067244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788625795.067314:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845743744:0@lo:400:kworker.0 00000100:00100000:3.0:1788625795.067340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845744128:0@lo:400:kworker.0 00000100:00080000:1.0:1788625795.067615:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625795.067652:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625795.067702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845743872 00000100:00100000:0.0:1788625795.067780:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845743872 00000100:00100000:0.0:1788625795.067813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788625795.067818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845743872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625795.067865:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845743872:12345-0@lo:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625795.067869:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788625795.067898:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625795.068046:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845743872:0@lo:400:kworker.0 00000100:00100000:2.0:1788625795.070340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.070687:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823685888 00000100:00100000:1.0:1788625795.070701:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823685888 00000100:00100000:1.0:1788625795.070826:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625795.070840:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:9726:x1875509823685888:12345-192.168.201.45@tcp:101:chmod.0 00010000:00010000:1.0:1788625795.070878:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625795.070909:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb137f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb16 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071007:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071024:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071342:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625795.071457:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788625795.071462:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625795.071512:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071544:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb137f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb16 expref: 8 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071569:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb16 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.071615:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625795.071619:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625795.071624:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031400, rc 0) 00000100:00100000:1.0:1788625795.071703:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9726:x1875509823685888:12345-192.168.201.45@tcp:101:chmod.0 Request processed in 866us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.071711:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1788625795.076668:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.076985:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823686144 00000100:00100000:3.0:1788625795.077499:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823686144 00000100:00100000:3.0:1788625795.077642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1788625795.077655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9726:x1875509823686144:12345-192.168.201.45@tcp:36:chmod.0 00010000:00010000:3.0:1788625795.077757:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625795.077795:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031400/0x8aede7274cb137f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb16 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.077831:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625795.077853:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625795.077905:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.077923:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.077934:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625795.078651:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4304e79 reply state 000000005714584f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625795.078667:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788625795.078678:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788625795.079010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:9726:x1875509823686144:12345-192.168.201.45@tcp:36:chmod.0 Request processed in 1354us (2353us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788625795.079019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00010000:00010000:1.0:1788625795.081275:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081298:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081309:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081315:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625795.081320:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081329:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081350:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039400) 00010000:00010000:1.0:1788625795.081354:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788625795.081360:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.081367:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb137ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625795.124478:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.124707:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823686272 00000100:00100000:1.0:1788625795.124721:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823686272 00000100:00100000:1.0:1788625795.124832:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1788625795.124858:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9727:x1875509823686272:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:1.0:1788625795.124892:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625795.124924:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb1d expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.125027:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.125055:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.125070:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625795.125117:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788625795.125121:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625795.125916:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.125962:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb1d expref: 9 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.125998:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb1d expref: 8 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.126008:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f300) 00010000:00010000:1.0:1788625795.126019:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625795.126024:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031800, rc 0) 00000100:00100000:1.0:1788625795.126112:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:9727:x1875509823686272:12345-192.168.201.45@tcp:101:chown.0 Request processed in 1268us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.126119:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1788625795.134102:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625795.134624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823686400 00000100:00100000:2.0:1788625795.134637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823686400 00000100:00100000:2.0:1788625795.134714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625795.134768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:9727:x1875509823686400:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:2.0:1788625795.134797:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625795.134835:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb24 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.134934:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.134953:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.134967:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.134997:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135005:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135012:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135123:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135132:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135156:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625795.135208:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788625795.135213:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625795.135240:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135255:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135263:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135269:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135275:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.135279:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135288:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135302:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f300) 00010000:00010000:2.0:1788625795.135305:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.135310:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135317:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb1381b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135339:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135345:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135351:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135357:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.135359:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135365:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135372:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b4356b43200) 00010000:00010000:2.0:1788625795.135374:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.135377:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135382:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13822 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135426:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb24 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135439:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb24 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.135457:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b4356b43f00) 00010000:00010000:2.0:1788625795.135460:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625795.135462:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017200, rc 0) 00000100:00100000:2.0:1788625795.135530:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:9727:x1875509823686400:12345-192.168.201.45@tcp:101:chown.0 Request processed in 805us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625795.135538:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625795.139960:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.140282:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823686656 00000100:00100000:1.0:1788625795.140296:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823686656 00000100:00100000:1.0:1788625795.140376:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1788625795.140399:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:9727:x1875509823686656:12345-192.168.201.45@tcp:36:chown.0 00010000:00010000:1.0:1788625795.140472:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625795.140509:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb13829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb24 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.140534:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b4356b43f00) 00010000:00010000:1.0:1788625795.140549:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625795.140592:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.140608:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.140619:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625795.249467:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788625795.249503:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788625795.249629:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3459a7f reply state 000000005a0f2f6b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625795.249647:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788625795.249667:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788625795.249822:0:6721:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788625795.249857:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9727:x1875509823686656:12345-192.168.201.45@tcp:36:chown.0 Request processed in 109465us (109906us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788625795.249867:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00010000:00010000:2.0:1788625795.250637:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250652:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250660:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250667:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340030600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.250673:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250682:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250704:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b4348a9fb00) 00010000:00010000:2.0:1788625795.250707:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788625795.250713:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.250770:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb13830 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625795.290601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.290715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823686784 00000100:00100000:3.0:1788625795.290784:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823686784 00000100:00100000:3.0:1788625795.290861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1788625795.290873:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:9728:x1875509823686784:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:3.0:1788625795.290904:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625795.290934:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb2b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625795.299967:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8965us 00010000:00010000:0.0:1788625795.320008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320040:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320069:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320091:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320099:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320106:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320670:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320679:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320685:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625795.320707:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788625795.320709:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625795.320767:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320780:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320785:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320798:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320803:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625795.320807:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320813:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320833:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f300) 00010000:00010000:0.0:1788625795.320836:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625795.320842:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320849:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb1383e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320864:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320871:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320877:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320883:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798daa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625795.320886:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320902:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320910:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b435917be00) 00010000:00010000:0.0:1788625795.320912:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625795.320915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb13845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320969:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb2b expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320985:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb2b expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.320993:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625795.320995:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788625795.320997:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db400, rc 0) 00000100:00100000:0.0:1788625795.321095:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9728:x1875509823686784:12345-192.168.201.45@tcp:101:touch.500 Request processed in 30222us (30518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625795.321103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00010000:00010000:3.0:1788625795.324550:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625795.327415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.327502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687040 00000100:00100000:3.0:1788625795.327515:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687040 00000100:00100000:3.0:1788625795.327603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1788625795.327614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:9728:x1875509823687040:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:3.0:1788625795.327660:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625795.327690:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13853 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb32 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.328655:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.328679:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.328694:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.330784:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.330809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.330823:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625795.332070:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788625795.332718:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333327:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333342:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333470:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333478:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333485:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333491:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.333495:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.333503:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.334082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:2.0:1788625795.334088:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.334156:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.334165:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb1385a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625795.334183:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f37dfa4 reply state 00000000ce95aea4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625795.334192:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788625795.335909:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13853 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb32 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.336424:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb32 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.336435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4356b43800) 00010000:00010000:2.0:1788625795.336438:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625795.336442:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016c00, rc 0) 00000100:00100000:2.0:1788625795.336700:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:9728:x1875509823687040:12345-192.168.201.45@tcp:101:touch.500 Request processed in 9086us (9307us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788625795.336709:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00010000:00010000:1.0:1788625795.340301:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340319:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340327:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340333:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625795.340338:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340346:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340483:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc942831e (ffff9b4356b43200) 00010000:00010000:1.0:1788625795.340487:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625795.340492:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.340499:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb13861 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625795.342534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.342779:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687296 00000100:00100000:3.0:1788625795.342797:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687296 00000100:00100000:3.0:1788625795.342889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1788625795.342903:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:9728:x1875509823687296:12345-192.168.201.45@tcp:36:touch.500 00010000:00010000:3.0:1788625795.342979:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625795.343019:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb32 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.343041:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4356b43800) 00010000:00010000:3.0:1788625795.343053:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625795.343112:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.343127:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.343138:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625795.343471:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001ec27fc reply state 00000000ebba3554 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625795.343483:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625795.343630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:9728:x1875509823687296:12345-192.168.201.45@tcp:36:touch.500 Request processed in 729us (1104us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788625795.343654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00010000:00010000:2.0:1788625795.346323:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346342:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346417:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346425:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.346430:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346438:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346456:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4352039600) 00010000:00010000:2.0:1788625795.346459:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.346464:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.346489:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13876 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625795.348203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.348275:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687424 00000100:00100000:1.0:1788625795.348288:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687424 00000100:00100000:1.0:1788625795.348363:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1788625795.348373:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:9728:x1875509823687424:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:1.0:1788625795.348411:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625795.348435:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031000/0x8aede7274cb1387d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb39 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.348495:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031000/0x8aede7274cb1387d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb39 expref: 10 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.348513:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031000/0x8aede7274cb1387d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb39 expref: 10 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.348532:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4348a9f500) 00010000:00010000:1.0:1788625795.348535:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625795.348539:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031000, rc 0) 00000100:00100000:1.0:1788625795.348620:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:9728:x1875509823687424:12345-192.168.201.45@tcp:101:touch.500 Request processed in 248us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.348628:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1788625795.352873:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.353164:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687552 00000100:00100000:1.0:1788625795.353187:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687552 00000100:00100000:1.0:1788625795.353247:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625795.353256:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875509823687552:12345-192.168.201.45@tcp:8:touch.500 00010000:00080000:1.0:1788625795.353294:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:1.0:1788625795.353331:0:6697:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb13884 00002000:00100000:1.0:1788625795.353345:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b12515be-537a-4a8b-a2d2-568b1a5329ac/ffff9b435dbb1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625795.353370:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625795.353615:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788625795.353652:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b435dbb2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625795.354022:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823687552:12345-192.168.201.45@tcp:8:touch.500 Request processed in 764us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.354039:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625795.356706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625795.356979:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687680 00000100:00100000:2.0:1788625795.356994:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687680 00000100:00100000:2.0:1788625795.357176:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1788625795.357190:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:0:x1875509823687680:12345-192.168.201.45@tcp:2:touch.500 00000100:00080000:0.0:1788625795.363066:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788625795.420714:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000001:00080000:1.0:1788625795.420762:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788625795.421287:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:0:x1875509823687680:12345-192.168.201.45@tcp:2:touch.500 Request processed in 64091us (64588us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788625795.421302:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1788625795.426387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625795.426540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823687936 00000100:00100000:2.0:1788625795.426553:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823687936 00000100:00100000:2.0:1788625795.426635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1788625795.426648:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:9728:x1875509823687936:12345-192.168.201.45@tcp:35:touch.500 00000100:00100000:0.0:1788625795.427423:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:9728:x1875509823687936:12345-192.168.201.45@tcp:35:touch.500 Request processed in 772us (1047us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788625795.427434:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1788625795.441712:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625795.442639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823688064 00000100:00100000:0.0:1788625795.442658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823688064 00000100:00100000:3.0:1788625795.443275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1788625795.443291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:9729:x1875509823688064:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:3.0:1788625795.443323:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625795.443352:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1388b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb40 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443441:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443460:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443474:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625795.443518:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625795.443522:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625795.443567:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443611:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1388b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb40 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443637:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb40 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.443647:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:3.0:1788625795.443667:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625795.443673:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625795.443964:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:9729:x1875509823688064:12345-192.168.201.45@tcp:101:rm.0 Request processed in 676us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625795.443971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1788625795.463653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625795.464002:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823688320 00000100:00100000:0.0:1788625795.464016:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823688320 00000100:00100000:0.0:1788625795.464225:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1788625795.464238:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:9729:x1875509823688320:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:0.0:1788625795.464267:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625795.464294:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb13899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb47 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625795.464426:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788625795.464677:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb13899 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb47 expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.464696:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f300) 00010000:00010000:0.0:1788625795.464700:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625795.464707:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb13899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb47 expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.464779:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dac00, rc 0) 00000100:00100000:0.0:1788625795.464880:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:9729:x1875509823688320:12345-192.168.201.45@tcp:101:rm.0 Request processed in 644us (1242us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788625795.464973:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:1.0:1788625795.469778:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.469877:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823688448 00000100:00100000:3.0:1788625795.469897:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823688448 00000100:00100000:3.0:1788625795.469967:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1788625795.469978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:9729:x1875509823688448:12345-192.168.201.45@tcp:37:rm.0 00000100:00100000:0.0:1788625795.476211:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:9729:x1875509823688448:12345-192.168.201.45@tcp:37:rm.0 Request processed in 6216us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625795.476228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1788625795.480350:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.480795:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823688704 00000100:00100000:1.0:1788625795.480809:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823688704 00000100:00100000:1.0:1788625795.480897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1788625795.480909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eac8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:9729:x1875509823688704:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:1.0:1788625795.481236:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eac8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:9729:x1875509823688704:12345-192.168.201.45@tcp:35:rm.0 Request processed in 327us (900us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788625795.481244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1788625795.485532:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625795.485781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823688960 00000100:00100000:0.0:1788625795.485794:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823688960 00000100:00100000:0.0:1788625795.485890:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1788625795.485905:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:9729:x1875509823688960:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:0.0:1788625795.485941:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625795.485971:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb138a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb4e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.486313:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb138ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.486332:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb138ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.486345:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb138ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625795.486358:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788625795.486559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb138a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb4e expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.486597:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb138ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb4e expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.486632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625795.486635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625795.486640:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625795.486801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823688960:12345-192.168.201.45@tcp:101:rm.0 Request processed in 899us (1285us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788625795.486809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:3.0:1788625795.494502:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625795.494700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823689088 00000100:00100000:2.0:1788625795.494714:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823689088 00000100:00100000:2.0:1788625795.494831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1788625795.494843:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689088:12345-192.168.201.45@tcp:41:rm.0 00000004:00000024:2.0:1788625795.494941:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788625795.495052:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689088:12345-192.168.201.45@tcp:41:rm.0 Request processed in 210us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625795.495060:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1788625795.498802:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625795.498929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823689216 00000100:00100000:0.0:1788625795.498944:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823689216 00000100:00100000:0.0:1788625795.499026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1788625795.499039:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689216:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:0.0:1788625795.499068:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625795.499280:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb138bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499469:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499487:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499495:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499527:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499668:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.499684:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625795.499718:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788625795.499723:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625795.501312:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.501344:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.501357:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.501365:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502235:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502241:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798daa00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625795.502247:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502256:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502278:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:1.0:1788625795.502282:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625795.502287:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502295:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798daa00/0x8aede7274cb138c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502322:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502329:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502336:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502341:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625795.502344:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502363:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502373:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc942831e (ffff9b435917be00) 00010000:00010000:1.0:1788625795.502376:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625795.502448:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502456:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb138ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502518:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb138bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb55 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502537:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb55 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625795.502546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4348a9f500) 00010000:00010000:1.0:1788625795.502548:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625795.502552:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dae00, rc 0) 00000100:00100000:1.0:1788625795.502720:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:9729:x1875509823689216:12345-192.168.201.45@tcp:101:rm.0 Request processed in 3681us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.502773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1788625795.508405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625795.508501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823689472 00000100:00100000:2.0:1788625795.508514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823689472 00000100:00100000:2.0:1788625795.508598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625795.508611:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:9729:x1875509823689472:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:2.0:1788625795.508688:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788625795.508758:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb138d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb55 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508789:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031000/0x8aede7274cb1387d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb39 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508804:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4348a9f500) 00010000:00010000:2.0:1788625795.508836:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb40 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508855:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:2.0:1788625795.508860:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625795.508896:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508912:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508926:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508944:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508952:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.508959:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.509469:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.509487:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.509496:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625795.511806:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788625795.511981:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345508252028ns, next at 346508247048ns, rc = 0 00010000:00010000:2.0:1788625795.512244:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512266:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512281:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512292:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512299:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512307:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512385:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625795.512416:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512423:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512445:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512452:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.512457:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512467:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512482:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4356b43500) 00010000:00010000:2.0:1788625795.512486:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788625795.512491:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512498:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb138e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512523:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512530:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512536:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512542:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.512545:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512563:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512572:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:2.0:1788625795.512574:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.512588:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.512594:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb138d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625795.512606:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e6a6303 reply state 00000000726abbba transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625795.512616:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625795.513515:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689472:12345-192.168.201.45@tcp:36:rm.0 Request processed in 4893us (5121us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788625795.513529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00010000:00010000:0.0:1788625795.513625:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625795.513636:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.513646:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625795.513651:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.513660:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.513674:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b4356b43500) 00010000:00010000:0.0:1788625795.513678:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788625795.513682:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.513689:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb138ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.513725:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625795.513742:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625795.513744:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625795.519789:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520061:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520142:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520150:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625795.520156:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520166:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520189:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc942831e (ffff9b4356b43b00) 00010000:00010000:0.0:1788625795.520192:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625795.520199:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.520206:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016800/0x8aede7274cb138df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc942831e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625795.520594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625795.520712:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823689728 00000100:00100000:1.0:1788625795.521337:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823689728 00000100:00100000:1.0:1788625795.521489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625795.521503:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:9729:x1875509823689728:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:1.0:1788625795.522321:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689728:12345-192.168.201.45@tcp:35:rm.0 Request processed in 815us (1739us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788625795.522331:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625795.527157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625795.527263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823689984 00000100:00100000:3.0:1788625795.527278:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823689984 00000100:00100000:3.0:1788625795.527374:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1788625795.527452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:9729:x1875509823689984:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1788625795.527531:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788625795.527567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb138ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb4e expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.527608:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb1384c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb2b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.527621:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b435917b700) 00010000:00010000:3.0:1788625795.527644:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340031800/0x8aede7274cb1380d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb1d expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625795.527678:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4348a9f300) 00010000:00010000:3.0:1788625795.527687:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625795.528661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.528687:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.528700:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.528716:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.528723:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.529568:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.530465:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.530484:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.530495:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625795.531658:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788625795.531684:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.531695:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.531704:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.531710:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.531716:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.531725:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532230:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b4356b43f00) 00010000:00010000:2.0:1788625795.532233:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788625795.532250:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532258:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13902 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532292:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532300:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532306:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532311:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625795.532314:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532321:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532329:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43800) 00010000:00010000:2.0:1788625795.532332:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625795.532335:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625795.532342:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb138f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625795.532355:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a690455 reply state 0000000099bfc168 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625795.532376:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625795.532618:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:9729:x1875509823689984:12345-192.168.201.45@tcp:36:rm.0 Request processed in 5165us (5618us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788625795.532629:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00010000:00010000:0.0:1788625795.538983:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539006:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539034:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539041:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625795.539047:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539057:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539087:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b4356b43200) 00010000:00010000:0.0:1788625795.539091:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625795.539098:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625795.539104:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017c00/0x8aede7274cb138fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625795.573506:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625795.573536:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845744384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625795.573636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625795.573922:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744384 00000100:00100000:1.0:1788625795.573933:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744384 00000100:00100000:1.0:1788625795.574000:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625795.574024:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845744384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625795.574261:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625795.574338:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845744384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 318us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625795.574346:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788625795.574799:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166e680 x1875509845744384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625795.574838:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845744384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625796.340704:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625797.364357:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625798.386841:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788625798.642982:0:6884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348639250902ns, next at 349639248346ns, rc = 0 00000100:00100000:1.0:1788625798.643110:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625798.643150:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845744512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625798.643222:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625798.643531:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744512 00000100:00100000:3.0:1788625798.643550:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744512 00000100:00100000:3.0:1788625798.643638:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788625798.643641:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625798.643657:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845744512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625798.643694:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625798.643778:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845744512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625798.643785:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788625798.644252:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4351619f80 x1875509845744512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625798.644274:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845744512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625798.808222:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625798.808268:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625798.808302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625798.808342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625798.808688:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690368 00000100:00100000:3.0:1788625798.808711:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690368 00000100:00100000:2.0:1788625798.808868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690112 00000100:00100000:2.0:1788625798.808873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690112 00000100:00100000:2.0:1788625798.808916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 255 00000100:00100000:2.0:1788625798.808926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823690112:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625798.808996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823690112:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 70us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625798.808997:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1788625798.809008:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 255 00000100:00100000:0.0:1788625798.809008:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690240 00000100:00100000:0.0:1788625798.809012:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690240 00000100:00100000:0.0:1788625798.809037:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690496 00000100:00100000:2.0:1788625798.809040:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:0.0:1788625798.809040:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690496 00000100:00100000:2.0:1788625798.809047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2364:x1875509823690240:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625798.809059:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:0.0:1788625798.809065:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823690496:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625798.809085:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2364:x1875509823690240:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625798.809091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:0.0:1788625798.809104:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823690496:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625798.809110:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:3.0:1788625798.813574:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823690368:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625798.813673:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823690368:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 120us (5404us total) trans 0 rc 0/0 00000100:00080000:1.0:1788625798.813769:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625798.813775:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625798.814770:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00010000:00010000:3.0:1788625799.412108:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625800.184881:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845744640:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.184979:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185055:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845745152:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185128:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625800.185134:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185160:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185205:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185243:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845744896:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185266:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185288:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625800.185293:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745024:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625800.185353:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744640 00000100:00100000:3.0:1788625800.185362:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744640 00000100:00100000:3.0:1788625800.185417:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788625800.185428:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845744640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.185484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845744640:12345-0@lo:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625800.185492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788625800.185543:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745152 00000100:00100000:3.0:1788625800.185547:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745152 00000100:00100000:3.0:1788625800.185586:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744768 00000100:00100000:3.0:1788625800.185589:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744768 00000100:00100000:3.0:1788625800.185603:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845744896 00000100:00100000:3.0:1788625800.185605:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845744896 00000100:00100000:3.0:1788625800.185620:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788625800.185625:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845745152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625800.185828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625800.185840:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845744768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625800.185878:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845744768:12345-0@lo:400:kworker.0 Request processed in 41us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625800.185884:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625800.185900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788625800.185905:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845744896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625800.185946:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845744896:12345-0@lo:400:kworker.0 Request processed in 41us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625800.185952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788625800.185997:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845744896:0@lo:400:kworker.0 00000001:02000400:1.0:1788625800.186715:0:11630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788625800.187154:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845745152:12345-0@lo:400:kworker.0 Request processed in 1524us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625800.187172:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788625800.187216:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745280 00000100:00100000:3.0:1788625800.187225:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745280 00000100:00100000:3.0:1788625800.187272:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745024 00000100:00100000:3.0:1788625800.187276:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745024 00000100:00100000:3.0:1788625800.187310:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625800.187321:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845745280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.187379:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845745280:12345-0@lo:400:kworker.0 Request processed in 61us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625800.187386:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625800.187396:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625800.187403:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845745024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.187435:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845745024:12345-0@lo:400:kworker.0 Request processed in 33us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625800.187441:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788625800.187459:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625800.187464:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625800.187467:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625800.187519:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd3480 x1875509845745024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625800.187534:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745024:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.187573:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845744768:0@lo:400:kworker.0 00010000:00080000:3.0:1788625800.187587:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fcd1880 x1875509845745280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625800.187596:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.187619:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845744640:0@lo:400:kworker.0 00000100:00100000:3.0:1788625800.187631:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845745152:0@lo:400:kworker.0 00000001:00080000:0.0:1788625800.299880:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1788625800.299912:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1788625800.299930:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788625800.299943:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788625800.299949:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788625800.300488:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788625800.300597:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625800.300706:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745408 00000100:00100000:0.0:1788625800.300717:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745408 00000100:00100000:0.0:1788625800.300804:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625800.300815:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845745408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788625800.300849:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788625800.300895:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c4383, atime: 0x6a9c4383, ctime: 0x6a9c4383, blocks: 0x1 00010000:00010000:0.0:1788625800.300905:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.300926:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1788625800.300932:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625800.300940:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.300961:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.300983:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.300993:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.301014:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625800.308842:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845745408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8015us (8232us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788625800.308860:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788625800.308905:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625800.308916:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.308931:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625800.308936:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.308949:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.308974:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.308983:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000617f8ccb/0x8aede7274cb13909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625800.309016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625800.309018:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625800.309020:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625800.309092:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b4343593100/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788625800.309101:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788625800.442409:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625800.692882:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625800.692914:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625800.693006:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625800.693188:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745536 00000100:00100000:1.0:1788625800.693198:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745536 00000100:00100000:1.0:1788625800.693263:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625800.693273:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845745536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625800.693318:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625800.693379:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845745536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625800.693388:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788625800.693533:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435166d180 x1875509845745536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625800.693557:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845745536:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788625800.807450:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:0.0:1788625801.403427:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccc9f29d0 20000000:00000080:0.0:1788625801.403447:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b43798dcc00 uarg=0000000000000000 20000000:01000000:0.0:1788625801.403929:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788625801.403936:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788625801.403941:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788625801.405437:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788625801.406407:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788625801.416102:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788625801.416154:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788625801.416385:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788625801.416404:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625801.416423:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416441:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137ab expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416448:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416454:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416536:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416547:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416555:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416605:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416620:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 12 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.416637:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745664:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625801.416880:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416890:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.416913:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745792:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625801.416947:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.416956:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 18 pid: 5835 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.416965:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745920:0@lo:104: 00000100:00100000:3.0:1788625801.417003:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625801.417043:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.417052:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 18 pid: 5836 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.417074:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845746048:0@lo:104: 00000100:00100000:3.0:1788625801.417095:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625801.417120:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.417129:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 18 pid: 5834 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.417137:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845746176:0@lo:104: 00000100:00100000:3.0:1788625801.417159:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625801.417186:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43554e19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625801.418591:0:8462:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788625801.418608:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845745920 00000100:00100000:0.0:1788625801.418615:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845745920 00000100:00100000:0.0:1788625801.418653:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746048 00000100:00100000:0.0:1788625801.419056:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746048 00000100:00100000:0.0:1788625801.419075:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746176 00000100:00100000:0.0:1788625801.419078:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746176 00000100:00100000:0.0:1788625801.419095:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625801.419105:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:11681:x1875509845745920:12345-0@lo:104: 00010000:00010000:0.0:1788625801.419121:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625801.419379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625801.419389:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:11681:x1875509845746048:12345-0@lo:104: 00010000:00010000:2.0:1788625801.419398:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419479:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625801.419486:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+5:11681:x1875509845746048:12345-0@lo:104: Request processed in 100us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625801.419493:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625801.419510:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625801.419517:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437fc46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:11681:x1875509845746176:12345-0@lo:104: 00010000:00010000:2.0:1788625801.419524:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419555:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625801.419560:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437fc46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+4:11681:x1875509845746176:12345-0@lo:104: Request processed in 45us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625801.419566:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788625801.419581:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625801.419586:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419594:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625801.419603:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419612:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625801.419619:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625801.419625:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625801.419659:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419666:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625801.419684:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419691:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb137b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419702:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625801.419705:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419724:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625801.419745:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419753:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625801.419768:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625801.419773:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625801.419787:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419792:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625801.419797:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419803:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb137ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.419812:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625801.419814:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625801.419815:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625801.419828:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845746304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625801.419860:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625801.420094:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625801.420101:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+3:11681:x1875509845745920:12345-0@lo:104: Request processed in 998us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625801.420107:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788625801.420142:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625801.420147:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.420153:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6800 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625801.420156:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.420174:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625801.420182:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625801.420187:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788625801.420201:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625801.420336:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625801.420347:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845746432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625801.420373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625801.420680:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625801.420839:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.420848:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb137c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb137ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.420877:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625801.420879:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625801.420881:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625801.420965:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746304 00000100:00100000:0.0:1788625801.420973:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746304 00010000:00010000:0.0:1788625801.420999:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 19 pid: 5836 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625801.421024:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746432 00000100:00100000:0.0:1788625801.421027:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746432 00010000:00010000:0.0:1788625801.421038:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 20 pid: 5834 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625801.421057:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625801.421065:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3308:x1875509845746304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625801.421076:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625801.421081:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 20 pid: 5836 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.421093:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 20 pid: 5836 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.421110:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625801.421147:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3308:x1875509845746304:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625801.421154:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625801.421178:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625801.421185:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845746432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625801.421200:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788625801.421623:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745920:0@lo:104: 00010000:00010000:3.0:1788625801.421636:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3600/0x8aede7274cb137c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb137b9 expref: 19 pid: 5836 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.421648:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845746048:0@lo:104: 00000100:00100000:3.0:1788625801.421657:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845746176:0@lo:104: 00000100:00100000:3.0:1788625801.422204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625801.422231:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845746560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625801.422288:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625801.422326:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625801.422357:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746560 00000100:00100000:3.0:1788625801.422362:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746560 00010000:00010000:3.0:1788625801.422385:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625801.422407:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625801.422425:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3311:x1875509845746560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625801.422436:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625801.422440:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.422451:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.422484:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2400/0x8aede7274cb137ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb137c7 expref: 19 pid: 5835 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.422498:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625801.422528:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3311:x1875509845746560:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625801.422535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625801.422561:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845746560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625801.422588:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845746304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625801.422889:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 17 pid: 5834 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.422966:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 17 pid: 5834 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.422977:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798da000/0x8aede7274cb137b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb137ab expref: 17 pid: 5834 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.422987:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625801.423023:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3308:x1875509845746432:12345-0@lo:103:ldlm_bl.0 Request processed in 1838us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625801.423030:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625801.423178:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845746432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625801.434359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625801.434386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625801.434421:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690624 00000100:00100000:0.0:1788625801.434431:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690624 00000100:00100000:3.0:1788625801.434799:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745664:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625801.434812:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875509845745792:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625801.434850:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.434921:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 13 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625801.434963:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690752 00000100:00100000:0.0:1788625801.434967:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690752 00010000:00010000:0.0:1788625801.434982:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 14 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625801.435001:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1788625801.435010:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+14:2365:x1875509823690624:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625801.435023:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625801.435041:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 14 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435053:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 14 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435069:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3c00/0x8aede7274cb137dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb0f expref: 14 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435082:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625801.435130:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823690624:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 121us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625801.435137:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1788625801.435154:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1788625801.435161:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:2365:x1875509823690752:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625801.435181:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625801.435186:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435194:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435416:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798da600/0x8aede7274cb137d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb08 expref: 12 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435429:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435438:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435460:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435619:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435627:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435635:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435641:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625801.435646:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435654:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435668:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625801.435678:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625801.435702:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+11:2365:x1875509823690752:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 541us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625801.435718:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00010000:00010000:2.0:1788625801.441346:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.441367:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625801.441374:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f6000/0x8aede7274cb13910 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625801.468658:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625802.485542:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625802.485619:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625802.485624:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437fc51000 from 7 10000000:01000000:1.0:1788625802.485629:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625802.485681:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.485692:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.485703:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625802.485751:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.485821:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.485892:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625802.487500:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746688 00000100:00100000:2.0:1788625802.487512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746688 00000100:00100000:2.0:1788625802.487579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788625802.487590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:5838:x1875509845746688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625802.487604:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625802.487624:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4371016800/0x8aede7274cb1391e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13917 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.487651:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4371016800/0x8aede7274cb1391e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13917 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.487663:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4371016800/0x8aede7274cb1391e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13917 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.487671:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016800, rc 0) 00000100:00100000:2.0:1788625802.487766:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845746688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625802.487772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788625802.488896:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625802.488917:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.488951:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625802.489041:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.489081:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.489133:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625802.490447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746816 00000100:00100000:2.0:1788625802.490486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746816 00000100:00100000:2.0:1788625802.490547:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788625802.490557:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845746816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625802.490845:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845746816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625802.490853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788625802.492140:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.492195:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.492285:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.492327:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625802.492401:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845746944 00000100:00100000:3.0:1788625802.492407:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845746944 00000100:00100000:3.0:1788625802.492452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788625802.492479:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845746944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.492655:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845746944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.492663:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788625802.492942:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845746944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.494478:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11694:1875509845747072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625802.494538:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.494576:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625802.494637:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747072 00000100:00100000:0.0:1788625802.494644:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747072 00000100:00100000:0.0:1788625802.494688:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788625802.494713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:11694:x1875509845747072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625802.494956:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:11694:x1875509845747072:12345-0@lo:502:llog_process_th.0 Request processed in 243us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625802.494963:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788625802.495448:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11694:1875509845747072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625802.495490:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625802.495500:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625802.495503:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625802.495514:0:11694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b437fc51000 00000020:00000080:1.0:1788625802.495517:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788625802.495597:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11694:1875509845747200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625802.495636:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.495665:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625802.496106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747200 00000100:00100000:2.0:1788625802.496112:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747200 00000100:00100000:2.0:1788625802.496166:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788625802.496175:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:11694:x1875509845747200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625802.496373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:11694:x1875509845747200:12345-0@lo:502:llog_process_th.0 Request processed in 199us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625802.496380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788625802.498583:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11694:1875509845747200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625802.498633:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625802.498641:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625802.498643:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788625802.498651:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788625802.500633:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788625802.500664:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625802.500675:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.500696:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625802.500706:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625802.500709:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4377f6e800 from 7 10000000:01000000:2.0:1788625802.500711:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625802.500765:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.500774:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625802.500785:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625802.500807:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625802.500867:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625802.501523:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.512221:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747328 00000100:00100000:1.0:1788625802.512237:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747328 00000100:00100000:1.0:1788625802.512555:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788625802.512567:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:5838:x1875509845747328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625802.512586:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625802.512603:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031000/0x8aede7274cb1392c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13925 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.512631:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031000/0x8aede7274cb1392c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13925 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.512642:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031000/0x8aede7274cb1392c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13925 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.512651:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031000, rc 0) 00000100:00100000:1.0:1788625802.512752:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (11883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.512759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788625802.514797:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625802.514825:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625802.514838:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625802.514947:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625802.515013:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625802.533231:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625802.536801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747456 00000100:00100000:3.0:1788625802.536817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747456 00000100:00100000:3.0:1788625802.536896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788625802.536908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.537204:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (22201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.537226:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788625802.537560:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.537615:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.537666:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625802.537681:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43554e1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625802.537798:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747584 00000100:00100000:3.0:1788625802.537803:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747584 00000100:00100000:3.0:1788625802.537826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788625802.537832:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.538528:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 694us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.538536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788625802.538995:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.539174:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11697:1875509845747712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625802.539224:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.539249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747712 00000100:00100000:1.0:1788625802.539254:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747712 00000100:00100000:1.0:1788625802.539465:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788625802.539476:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:11697:x1875509845747712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625802.539533:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.539642:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:11697:x1875509845747712:12345-0@lo:502:llog_process_th.0 Request processed in 169us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.539649:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788625802.539719:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11697:1875509845747712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625802.539758:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625802.539768:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625802.539770:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625802.539776:0:11697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b4377f6e800 00000020:00000080:0.0:1788625802.539779:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625802.539848:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11697:1875509845747840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625802.539880:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625802.539900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747840 00000100:00100000:0.0:1788625802.539905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747840 00000100:00100000:0.0:1788625802.539925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788625802.539931:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:11697:x1875509845747840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625802.540220:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:11697:x1875509845747840:12345-0@lo:502:llog_process_th.0 Request processed in 288us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625802.540227:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788625802.540261:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625802.540273:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11697:1875509845747840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625802.540290:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625802.540295:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625802.540297:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788625802.540301:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788625802.541033:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788625802.541054:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625802.541065:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541077:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625802.541088:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625802.541091:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346652800 from 7 10000000:01000000:1.0:1788625802.541094:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625802.541124:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541133:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541142:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625802.541158:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.541192:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.541228:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.541243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845747968 00000100:00100000:1.0:1788625802.541267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845747968 00000100:00100000:1.0:1788625802.541803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788625802.541811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:5838:x1875509845747968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625802.541822:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625802.541835:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340030e00/0x8aede7274cb1393a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb13933 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541857:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340030e00/0x8aede7274cb1393a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb13933 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541884:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340030e00/0x8aede7274cb1393a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb13933 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541892:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340030e00, rc 0) 00000100:00100000:1.0:1788625802.541928:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845747968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.541933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788625802.541968:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845747968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625802.541980:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.541989:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625802.542035:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845748096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.542060:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.542072:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.542083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748096 00000100:00100000:1.0:1788625802.542093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748096 00000100:00100000:1.0:1788625802.542111:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788625802.542117:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845748096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.543048:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845748096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 927us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.543056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788625802.543506:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845748096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625802.543548:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845748224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625802.543591:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625802.543625:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.544403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748224 00000100:00100000:1.0:1788625802.544410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748224 00000100:00100000:1.0:1788625802.544495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788625802.544505:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845748224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.547790:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:5838:x1875509845748224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3273us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.547803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788625802.548167:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:5838:1875509845748224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625802.549003:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11698:1875509845748352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625802.549064:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625802.549112:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625802.549168:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748352 00000100:00100000:3.0:1788625802.549175:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748352 00000100:00100000:3.0:1788625802.549227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788625802.549237:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:11698:x1875509845748352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625802.549449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:11698:x1875509845748352:12345-0@lo:502:llog_process_th.0 Request processed in 214us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.549467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788625802.549607:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11698:1875509845748352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625802.549636:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625802.549647:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625802.549649:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625802.549661:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b4346652800 00000020:00000080:1.0:1788625802.549663:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788625802.549780:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11698:1875509845748480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625802.549819:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625802.549843:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748480 00000100:00100000:1.0:1788625802.549847:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748480 00000100:00100000:1.0:1788625802.549890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788625802.549897:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:11698:x1875509845748480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625802.550011:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:11698:x1875509845748480:12345-0@lo:502:llog_process_th.0 Request processed in 114us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.550025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788625802.550056:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625802.550068:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:11698:1875509845748480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625802.550087:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625802.550092:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625802.550094:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788625802.550098:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788625802.550153:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788625802.550172:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625802.550183:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.550195:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625802.554439:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625802.649439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625802.650716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823690880 00000100:00100000:1.0:1788625802.650747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823690880 00000100:00100000:1.0:1788625802.650801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 272 00000100:00100000:1.0:1788625802.650812:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+11:5606:x1875509823690880:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625802.650829:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625802.650849:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4340031400/0x8aede7274cb13941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb5c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.650893:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4340031400/0x8aede7274cb13941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb5c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.650907:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4340031400/0x8aede7274cb13941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb5c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625802.650932:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4340031400, rc 0) 00000100:00100000:1.0:1788625802.650990:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823690880:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.650998:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 272 00000100:00100000:0.0:1788625802.653806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625802.653908:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691008 00000100:00100000:3.0:1788625802.653919:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691008 00000100:00100000:3.0:1788625802.653972:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 273 00000100:00100000:3.0:1788625802.653983:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823691008:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.654505:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823691008:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 521us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.654514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 273 00000100:00100000:1.0:1788625802.665514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625802.665585:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691136 00000100:00100000:3.0:1788625802.665597:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691136 00000100:00100000:3.0:1788625802.665648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:3.0:1788625802.665659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823691136:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625802.665917:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823691136:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 259us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.665926:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:3.0:1788625802.669465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625802.669502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691264 00000100:00100000:3.0:1788625802.669511:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691264 00000100:00100000:3.0:1788625802.669596:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 275 00000100:00100000:3.0:1788625802.669607:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:9999:x1875509823691264:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625802.669841:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:9999:x1875509823691264:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 234us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.669858:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 275 00000100:00100000:3.0:1788625802.677326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625802.677402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691392 00000100:00100000:1.0:1788625802.677412:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691392 00000100:00100000:1.0:1788625802.677471:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 276 00000100:00100000:1.0:1788625802.677481:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:9999:x1875509823691392:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625802.677723:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:9999:x1875509823691392:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 242us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.677753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 276 00000100:00100000:3.0:1788625802.691352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625802.691465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691520 00000100:00100000:0.0:1788625802.691475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691520 00000100:00100000:0.0:1788625802.691528:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 277 00000100:00100000:0.0:1788625802.691538:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+12:5606:x1875509823691520:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625802.691554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625802.691584:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43798daa00/0x8aede7274cb13948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb63 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625802.691611:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43798daa00/0x8aede7274cb13948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb63 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625802.691623:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43798daa00/0x8aede7274cb13948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb63 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625802.691632:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798daa00, rc 0) 00000100:00100000:0.0:1788625802.691686:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823691520:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625802.691693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 277 00000100:00100000:3.0:1788625802.703423:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625802.703532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691648 00000100:00100000:0.0:1788625802.703544:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691648 00000100:00100000:0.0:1788625802.703599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 278 00000100:00100000:0.0:1788625802.703609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823691648:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625802.704059:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823691648:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 450us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625802.704077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 278 00000100:00100000:3.0:1788625802.725235:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625802.725488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691776 00000100:00100000:1.0:1788625802.725499:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691776 00000100:00100000:1.0:1788625802.725560:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:1.0:1788625802.725571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823691776:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625802.725847:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:5606:x1875509823691776:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 276us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625802.725856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:3.0:1788625802.739568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625802.740980:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823691904 00000100:00100000:0.0:1788625802.740994:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823691904 00000100:00100000:0.0:1788625802.741046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 280 00000100:00100000:0.0:1788625802.741057:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:10002:x1875509823691904:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625802.741566:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:10002:x1875509823691904:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 508us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625802.741581:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 280 00000100:00100000:0.0:1788625802.751443:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625802.751602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692032 00000100:00100000:3.0:1788625802.751613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692032 00000100:00100000:3.0:1788625802.751673:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 281 00000100:00100000:3.0:1788625802.751685:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:10002:x1875509823692032:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625802.751986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:10002:x1875509823692032:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 302us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625802.751995:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 281 00010000:00010000:3.0:1788625803.506991:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625803.571298:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625803.767106:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845748608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625803.767179:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625803.767551:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748608 00000100:00100000:1.0:1788625803.767560:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748608 00000100:00100000:1.0:1788625803.767639:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625803.767650:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845748608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625803.767686:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788625803.767796:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625803.771636:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845748608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3975us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625803.771652:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625803.777979:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788625803.777992:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b4343593100, transno 4294967300 00000100:00100000:0.0:1788625803.778044:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845748608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625803.930359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625803.930442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625803.930474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625803.930512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625803.930835:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692288 00000100:00100000:0.0:1788625803.930846:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692288 00000100:00100000:0.0:1788625803.930907:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692544 00000100:00100000:0.0:1788625803.930911:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692544 00000100:00100000:0.0:1788625803.930934:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:0.0:1788625803.930943:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823692288:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625803.931019:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823692288:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 77us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625803.931027:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:0.0:1788625803.931044:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:0.0:1788625803.931050:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823692544:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625803.931073:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823692544:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625803.931089:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:0.0:1788625803.931108:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692416 00000100:00100000:0.0:1788625803.931111:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692416 00000100:00100000:0.0:1788625803.931138:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:0.0:1788625803.931145:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823692416:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625803.931171:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823692416:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625803.931178:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00080000:3.0:1788625803.933832:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625803.933843:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625803.934566:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692160 00000100:00100000:1.0:1788625803.938498:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692160 00000100:00100000:1.0:1788625803.938602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 282 00000100:00100000:1.0:1788625803.938614:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823692160:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625803.938795:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823692160:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 183us (8446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625803.938804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 282 00010000:00010000:3.0:1788625804.533838:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625805.299022:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845748864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.299070:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845748992:0@lo:400:kworker.0 00000100:00100000:0.0:1788625805.299098:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625805.299132:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748864 00000100:00100000:3.0:1788625805.299145:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748864 00000100:00100000:0.0:1788625805.299164:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845749376:0@lo:400:kworker.0 00000100:00100000:0.0:1788625805.299190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625805.299202:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788625805.299212:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845748864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625805.299220:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788625805.299230:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.299263:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845748864:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625805.299269:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788625805.299274:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625805.299277:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749376 00000100:00100000:1.0:1788625805.299284:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749376 00000100:00100000:3.0:1788625805.299298:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625805.299301:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845749248:0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.299321:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625805.299326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625805.299331:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845749120:0@lo:400:kworker.0 00000100:00100000:1.0:1788625805.299352:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625805.299359:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625805.299360:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845748864:0@lo:400:kworker.0 00000100:00100000:1.0:1788625805.299367:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.299393:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748992 00000100:00100000:3.0:1788625805.299396:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748992 00000100:00080000:0.0:1788625805.299400:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625805.299419:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625805.299434:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845749376:12345-0@lo:400:kworker.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625805.299443:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625805.299460:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749120 00000100:00100000:1.0:1788625805.299464:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749120 00000100:00100000:1.0:1788625805.299491:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625805.299497:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845749120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625805.299532:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845749120:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625805.299540:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788625805.299544:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625805.299569:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43656b0700 x1875509845749376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625805.299577:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845749120:0@lo:400:kworker.0 00000100:00100000:0.0:1788625805.299579:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845749376:0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.299622:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749248 00000100:00100000:3.0:1788625805.299627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749248 00000100:00080000:0.0:1788625805.299658:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625805.299663:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788625805.299672:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845748992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625805.300024:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788625805.300031:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625805.300552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845749248:12345-0@lo:400:kworker.0 Request processed in 519us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625805.300558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788625805.300587:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788625805.300616:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845748736 00000100:00100000:2.0:1788625805.300621:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845748736 00000100:00100000:2.0:1788625805.300648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788625805.300655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625805.301020:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845748736:12345-0@lo:400:kworker.0 Request processed in 365us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625805.301025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788625805.301053:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625805.302826:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845748992:12345-0@lo:400:kworker.0 Request processed in 3144us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625805.302838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788625805.302976:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845748992:0@lo:400:kworker.0 00010000:00010000:0.0:1788625805.555380:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625805.811535:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625805.811558:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625805.811627:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625805.811710:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749504 00000100:00100000:0.0:1788625805.811720:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749504 00000100:00100000:0.0:1788625805.811784:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625805.811793:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845749504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625805.811829:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625805.811873:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845749504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625805.811894:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788625805.811933:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343591c00 x1875509845749504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625805.811952:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845749504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625806.578949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625807.606447:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625808.626935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625808.883613:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625808.883635:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625808.883710:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625808.883875:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749632 00000100:00100000:2.0:1788625808.883882:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749632 00000100:00100000:2.0:1788625808.883939:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625808.883947:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845749632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625808.883979:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625808.884019:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845749632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625808.884026:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788625808.884079:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625808.884113:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625809.048857:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625809.048910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625809.048953:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625809.049202:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692800 00000100:00100000:0.0:1788625809.049215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692800 00000100:00100000:0.0:1788625809.049313:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693056 00000100:00100000:0.0:1788625809.049317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693056 00000100:00100000:0.0:1788625809.049356:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:0.0:1788625809.049368:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823692800:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625809.049462:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823692800:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 96us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625809.049471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:0.0:1788625809.049493:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:0.0:1788625809.049500:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823693056:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625809.049527:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823693056:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625809.049533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00080000:1.0:1788625809.050224:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625809.050778:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625809.051311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692672 00000100:00100000:1.0:1788625809.051323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692672 00000100:00100000:1.0:1788625809.051412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 284 00000100:00100000:1.0:1788625809.051422:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823692672:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625809.051518:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823692672:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 97us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625809.051526:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 284 00000100:00100000:0.0:1788625809.051759:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823692928 00000100:00100000:0.0:1788625809.051769:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823692928 00000100:00100000:0.0:1788625809.051836:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1788625809.051846:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823692928:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625809.051901:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823692928:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 58us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625809.051926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00080000:1.0:1788625809.052115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788625809.654343:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625810.422262:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845750144:0@lo:400:kworker.0 00000100:00100000:0.0:1788625810.422369:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625810.422437:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625810.422443:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845750016:0@lo:400:kworker.0 00000100:00100000:0.0:1788625810.422469:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625810.422505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750016 00000100:00100000:0.0:1788625810.422511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750016 00000100:00100000:0.0:1788625810.422565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788625810.422576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845750016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625810.422622:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845750016:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625810.422629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788625810.422672:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845750016:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.422752:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845749888:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.422781:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625810.422808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845750400:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.422829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625810.422848:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625810.422853:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845749760:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.422877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625810.422899:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845750272:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.422932:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625810.422960:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750144 00000100:00100000:1.0:1788625810.422964:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750144 00000100:00100000:1.0:1788625810.423006:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750400 00000100:00100000:1.0:1788625810.423010:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750400 00000100:00100000:1.0:1788625810.423029:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625810.423035:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423071:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845750144:12345-0@lo:400:kworker.0 Request processed in 37us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625810.423077:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625810.423090:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625810.423096:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423125:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845750400:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625810.423131:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788625810.423146:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625810.423149:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625810.423151:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625810.423164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749760 00000100:00100000:1.0:1788625810.423168:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749760 00000100:00100000:1.0:1788625810.423188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788625810.423195:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845749760:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625810.423228:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788625810.423253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845749888 00000100:00100000:1.0:1788625810.423255:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845749888 00000100:00100000:1.0:1788625810.423275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750272 00000100:00100000:1.0:1788625810.423278:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750272 00000100:00100000:1.0:1788625810.423299:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788625810.423304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845749888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423357:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845749888:12345-0@lo:400:kworker.0 Request processed in 52us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625810.423363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788625810.423375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788625810.423380:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423403:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845750272:12345-0@lo:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625810.423408:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788625810.423428:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625810.423447:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845749760:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423457:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845750272:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423466:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845749888:0@lo:400:kworker.0 00010000:00080000:1.0:1788625810.423477:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343590000 x1875509845750400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625810.423488:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845750400:0@lo:400:kworker.0 00000100:00100000:1.0:1788625810.423515:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845750144:0@lo:400:kworker.0 00010000:00010000:3.0:1788625810.675105:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625810.931316:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845750528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625810.931403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625810.931687:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750528 00000100:00100000:0.0:1788625810.931696:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750528 00000100:00100000:0.0:1788625810.931762:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625810.931771:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845750528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625810.931802:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625810.933015:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845750528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1240us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625810.933025:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788625810.941694:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343592d80 x1875509845750528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625810.941724:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845750528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625811.701539:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625812.723073:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625813.747047:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625813.811421:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625814.002994:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625814.003036:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845750656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625814.003121:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625814.003200:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750656 00000100:00100000:2.0:1788625814.003209:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750656 00000100:00100000:2.0:1788625814.003309:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625814.003319:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845750656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625814.003354:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625814.003400:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845750656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625814.003407:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625814.003458:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845750656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625814.003484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625814.166312:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625814.166371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625814.166414:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625814.166457:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625814.166468:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693312 00000100:00100000:2.0:1788625814.166480:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693312 00000100:00100000:1.0:1788625814.166533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693568 00000100:00100000:1.0:1788625814.166539:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693568 00000100:00100000:2.0:1788625814.166561:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:2.0:1788625814.166574:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823693312:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625814.166602:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693184 00000100:00100000:3.0:1788625814.166607:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693184 00000100:00100000:2.0:1788625814.166657:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823693312:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625814.166702:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 286 00000100:00080000:0.0:1788625814.166716:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625814.166719:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823693184:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625814.166784:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693440 00000100:00100000:3.0:1788625814.166785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823693184:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625814.166791:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693440 00000100:00100000:3.0:1788625814.166797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 286 00000100:00100000:0.0:1788625814.166837:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:0.0:1788625814.166847:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823693440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625814.166879:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823693440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625814.166887:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00080000:0.0:1788625814.166905:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625814.168292:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:1.0:1788625814.168309:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823693568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625814.168378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823693568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625814.168387:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:2.0:1788625814.172988:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00010000:00010000:1.0:1788625814.772521:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625815.539126:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.539171:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845750912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625815.539195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625815.539199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625815.539255:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788625815.539578:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.547879:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845751424:0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.547967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625815.548057:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751168 00000100:00100000:2.0:1788625815.548066:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751168 00000100:00100000:2.0:1788625815.548112:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751424 00000100:00100000:2.0:1788625815.548127:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751424 00000100:00100000:2.0:1788625815.548174:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788625815.548184:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.548249:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751168:12345-0@lo:400:kworker.0 Request processed in 67us (9054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625815.548256:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788625815.548274:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625815.548280:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.548313:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845751424:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625815.548320:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788625815.548338:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788625815.548370:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b434fc05f80 x1875509845751424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625815.548384:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845751424:0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.548426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750912 00000100:00100000:2.0:1788625815.548430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750912 00000100:00100000:2.0:1788625815.548459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788625815.548466:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.548501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845750912:12345-0@lo:400:kworker.0 Request processed in 36us (9301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625815.548507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788625815.548540:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845750912:0@lo:400:kworker.0 00000100:00100000:3.0:1788625815.550195:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625815.550263:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845751296:0@lo:400:kworker.0 00000100:00100000:3.0:1788625815.550301:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625815.550363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845750784 00000100:00100000:2.0:1788625815.550371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845750784 00000100:00100000:0.0:1788625815.550458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625815.551389:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751168:0@lo:400:kworker.0 00000100:00100000:0.0:1788625815.552004:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751296 00000100:00100000:0.0:1788625815.552011:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751296 00000100:00100000:0.0:1788625815.552072:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751040 00000100:00100000:0.0:1788625815.552076:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751040 00000100:00100000:0.0:1788625815.552099:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788625815.552110:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845751296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625815.556642:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625815.556671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845751040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625815.556794:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845751040:12345-0@lo:400:kworker.0 Request processed in 137us (6335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625815.556802:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625815.556868:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788625815.558717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788625815.558766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845750784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788625815.561617:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625815.562250:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845751296:12345-0@lo:400:kworker.0 Request processed in 10135us (11941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625815.562264:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788625815.563629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845750784:12345-0@lo:400:kworker.0 Request processed in 4865us (13432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625815.564145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788625815.565725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845750784:0@lo:400:kworker.0 00000100:00100000:1.0:1788625815.565982:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845751296:0@lo:400:kworker.0 00010000:00010000:3.0:1788625815.794972:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625816.052480:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625816.052510:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625816.052580:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625816.053163:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751552 00000100:00100000:2.0:1788625816.053173:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751552 00000100:00100000:2.0:1788625816.053236:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625816.053246:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625816.053282:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625816.053340:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625816.053348:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788625816.053539:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343590e00 x1875509845751552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625816.053559:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625816.821578:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625817.843105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625818.867100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625819.123365:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625819.123441:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625819.123785:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751680 00000100:00100000:2.0:1788625819.123793:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751680 00000100:00100000:2.0:1788625819.123862:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625819.123872:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625819.123908:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625819.123954:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845751680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (513us total) trans 0 rc 0/0 00000100:00080000:1.0:1788625819.124095:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625819.124134:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625819.124635:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625819.289859:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625819.289905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625819.290505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693824 00000100:00100000:2.0:1788625819.290517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693824 00000100:00100000:2.0:1788625819.290603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1788625819.290614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823693824:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625819.290689:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823693824:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 77us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625819.290713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00080000:0.0:1788625819.291155:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625819.291255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693696 00000100:00100000:1.0:1788625819.291261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693696 00000100:00100000:1.0:1788625819.291309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 288 00000100:00100000:1.0:1788625819.291317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823693696:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625819.291353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823693696:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625819.291369:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 288 00000100:00100000:3.0:1788625819.304076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625819.304319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694080 00000100:00100000:1.0:1788625819.304330:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694080 00000100:00100000:1.0:1788625819.304418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:1.0:1788625819.304428:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823694080:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625819.304519:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823694080:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 92us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625819.304527:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00080000:0.0:1788625819.304709:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625819.306622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625819.306765:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823693952 00000100:00100000:2.0:1788625819.306774:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823693952 00000100:00100000:2.0:1788625819.306854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625819.306863:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2362:x1875509823693952:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1788625819.306892:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13884 00000100:00080000:2.0:1788625819.306900:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b435dbb2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625819.306951:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788625819.307241:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+2:2362:x1875509823693952:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 378us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625819.307250:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:0.0:1788625819.307818:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788625819.307929:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625819.891161:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625820.659648:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845751808:0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.659720:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625820.659833:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845752320:0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.659863:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625820.659892:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625820.659898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845751936:0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.659922:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625820.660079:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845752448:0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.660254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625820.660298:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751808 00000100:00100000:1.0:1788625820.660306:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751808 00000100:00100000:1.0:1788625820.660352:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788625820.660362:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845751808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.660412:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845751808:12345-0@lo:400:kworker.0 Request processed in 53us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625820.660431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788625820.660469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752320 00000100:00100000:1.0:1788625820.660474:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752320 00000100:00100000:1.0:1788625820.660508:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845751936 00000100:00100000:2.0:1788625820.660677:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752448 00000100:00100000:2.0:1788625820.660681:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752448 00000100:00100000:2.0:1788625820.660713:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625820.660720:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.660776:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845752448:12345-0@lo:400:kworker.0 Request processed in 56us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625820.660783:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625820.660807:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.660834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625820.660855:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625820.660862:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.660885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625820.660908:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752192 00000100:00100000:2.0:1788625820.660911:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752192 00000100:00100000:2.0:1788625820.660947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625820.660961:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.660998:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845752192:12345-0@lo:400:kworker.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625820.661004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625820.661021:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752064 00000100:00100000:2.0:1788625820.661025:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752064 00000100:00100000:2.0:1788625820.661043:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625820.661048:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.661079:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845752320:12345-0@lo:400:kworker.0 Request processed in 31us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625820.661102:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625820.661114:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788625820.661120:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.661162:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845752064:12345-0@lo:400:kworker.0 Request processed in 42us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625820.661168:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788625820.661205:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.661214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845752192:0@lo:400:kworker.0 00010000:00080000:2.0:1788625820.661258:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b435db03b80 x1875509845752448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625820.661268:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845752448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.661278:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845751808:0@lo:400:kworker.0 00000100:00100000:2.0:1788625820.661287:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845752320:0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.661740:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845751936 00000100:00100000:1.0:1788625820.661780:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788625820.661786:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845751936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625820.661829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845751936:12345-0@lo:400:kworker.0 Request processed in 42us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625820.661835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788625820.661863:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845751936:0@lo:400:kworker.0 00000100:00080000:0.0:1788625820.662063:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625820.662074:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788625820.915486:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625821.174005:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845752576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625821.174103:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625821.174211:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752576 00000100:00100000:0.0:1788625821.174220:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752576 00000100:00100000:0.0:1788625821.174267:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625821.174277:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845752576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625821.174312:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625821.174354:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845752576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625821.174360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788625821.174397:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343592680 x1875509845752576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625821.174415:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845752576:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788625821.279157:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:0.0:1788625821.279166:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b435dbb1800/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:2.0:1788625821.279250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b435dbb1800/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-OST0000 00000020:00000080:2.0:1788625821.279305:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b435dbb2800 for lustre-OST0000 00010000:00010000:1.0:1788625821.946251:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625822.969399:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625823.042014:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788625823.987941:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625824.243522:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625824.243544:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845752704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625824.243611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625824.243773:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752704 00000100:00100000:1.0:1788625824.243782:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752704 00000100:00100000:1.0:1788625824.243840:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625824.243850:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845752704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625824.243885:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625824.243933:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845752704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625824.243941:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788625824.243962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625824.243999:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845752704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625824.412429:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625824.412474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625824.412505:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625824.412539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694336 00000100:00100000:1.0:1788625824.412547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694464 00000100:00100000:2.0:1788625824.412548:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694336 00000100:00100000:1.0:1788625824.412550:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694464 00000100:00100000:3.0:1788625824.412596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694208 00000100:00100000:3.0:1788625824.412601:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694208 00000100:00100000:3.0:1788625824.412650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 290 00000100:00100000:3.0:1788625824.412661:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823694208:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625824.412756:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823694208:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 96us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625824.412763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 290 00000100:00100000:2.0:1788625824.412962:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:2.0:1788625824.412969:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823694336:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625824.413005:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823694336:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625824.413011:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:1.0:1788625824.417684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1788625824.417701:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823694464:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625824.417807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823694464:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 111us (5300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625824.417815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00080000:3.0:1788625824.423772:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625825.011632:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625825.785481:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845752832:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785551:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785600:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845753344:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785627:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785654:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625825.785660:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845752960:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785681:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785697:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785720:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785781:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785818:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785840:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625825.785866:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.785893:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625825.785926:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752832 00000100:00100000:3.0:1788625825.785933:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752832 00000100:00100000:3.0:1788625825.785974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788625825.785982:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845752832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786029:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845752832:12345-0@lo:400:kworker.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788625825.786078:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753344 00000100:00100000:3.0:1788625825.786082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753344 00000100:00100000:3.0:1788625825.786113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845752960 00000100:00100000:3.0:1788625825.786115:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845752960 00000100:00100000:3.0:1788625825.786127:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753088 00000100:00100000:3.0:1788625825.786130:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753088 00000100:00100000:3.0:1788625825.786143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788625825.786149:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845753344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845753344:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788625825.786195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788625825.786201:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845752960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786227:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845752960:12345-0@lo:400:kworker.0 Request processed in 27us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788625825.786244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625825.786250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845753088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786300:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845753088:12345-0@lo:400:kworker.0 Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786306:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625825.786327:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753472 00000100:00100000:3.0:1788625825.786330:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753472 00000100:00100000:3.0:1788625825.786352:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753216 00000100:00100000:3.0:1788625825.786354:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753216 00000100:00100000:3.0:1788625825.786370:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625825.786376:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845753472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786414:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845753472:12345-0@lo:400:kworker.0 Request processed in 38us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786420:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625825.786431:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788625825.786436:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845753216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786458:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845753216:12345-0@lo:400:kworker.0 Request processed in 22us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625825.786463:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788625825.786487:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625825.786491:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625825.786526:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786536:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786586:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845752960:0@lo:400:kworker.0 00010000:00080000:3.0:1788625825.786599:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b43656b3100 x1875509845753472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625825.786610:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786625:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845752832:0@lo:400:kworker.0 00000100:00100000:3.0:1788625825.786635:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845753344:0@lo:400:kworker.0 00000001:02000400:1.0:1788625826.013325:0:11861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:30:24 (1788625824) 00010000:00010000:3.0:1788625826.045400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625826.291145:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625826.291170:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845753600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625826.291240:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625826.291364:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753600 00000100:00100000:1.0:1788625826.291372:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753600 00000100:00100000:1.0:1788625826.291428:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625826.291438:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845753600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625826.291473:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625826.291524:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845753600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625826.291531:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788625826.291571:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4343592680 x1875509845753600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625826.291600:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845753600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788625827.058966:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625827.944317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625827.944441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694592 00000100:00100000:2.0:1788625827.944458:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694592 00000100:00080000:3.0:1788625827.944547:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625827.944648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1788625827.944667:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:10273:x1875509823694592:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625827.944697:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625827.944767:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb1394f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb6a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.944873:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.944891:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.944933:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625827.944987:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788625827.944992:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625827.945058:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.945090:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb1394f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb6a expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.945113:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb6a expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625827.945124:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:2.0:1788625827.945128:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625827.945133:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017800, rc 0) 00000100:00100000:2.0:1788625827.945215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:10273:x1875509823694592:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 554us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625827.945223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1788625827.955896:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625827.955990:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694720 00000100:00100000:3.0:1788625827.956001:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694720 00000100:00100000:3.0:1788625827.956081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1788625827.956092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:10274:x1875509823694720:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625827.956114:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625827.956136:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb1395d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956241:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956255:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956270:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956277:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956283:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956567:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956576:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956583:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625827.956611:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625827.956615:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625827.956639:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956650:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956656:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956663:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956670:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625827.956674:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956682:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956696:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:3.0:1788625827.956705:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625827.956711:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956717:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956776:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956782:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956787:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956790:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625827.956793:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956798:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956806:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b4352039800) 00010000:00010000:3.0:1788625827.956808:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625827.956811:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956815:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb1396b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956845:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb1395d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb71 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956874:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb71 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625827.956882:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039300) 00010000:00010000:3.0:1788625827.956884:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625827.956886:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6800, rc 0) 00000100:00100000:3.0:1788625827.956940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10274:x1875509823694720:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 850us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625827.956948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1788625827.967127:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625827.967245:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823694976 00000100:00100000:0.0:1788625827.967254:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823694976 00000100:00100000:0.0:1788625827.967320:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1788625827.967332:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10274:x1875509823694976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625827.967354:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625827.967376:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13979 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb78 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967468:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967483:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967496:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967548:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967557:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967564:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967949:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb1398e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb1398e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.967970:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb1398e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625827.967979:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788625827.968138:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968145:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968158:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968164:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625827.968168:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968175:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968187:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039300) 00010000:00010000:0.0:1788625827.968190:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625827.968194:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968200:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13980 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968211:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968217:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968222:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968226:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625827.968228:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968245:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968253:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b435917b900) 00010000:00010000:0.0:1788625827.968255:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625827.968258:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968263:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13987 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13979 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb78 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968792:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb1398e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb78 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625827.968800:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:0.0:1788625827.968802:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625827.968805:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dac00, rc 0) 00000100:00100000:0.0:1788625827.968864:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10274:x1875509823694976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1534us (1747us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788625827.968873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1788625827.988995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625827.989126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695104 00000100:00100000:3.0:1788625827.989137:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695104 00000100:00100000:3.0:1788625827.989205:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:3.0:1788625827.989217:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10274:x1875509823695104:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788625827.990600:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10274:x1875509823695104:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 1374us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625827.990611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00010000:00010000:1.0:1788625828.093090:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625828.148691:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788625829.113195:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625829.364083:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845753728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625829.364188:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625829.364317:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845753728 00000100:00100000:1.0:1788625829.364330:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845753728 00000100:00100000:1.0:1788625829.364423:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788625829.364434:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845753728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625829.364479:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625829.364533:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845753728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625829.364635:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788625829.364698:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845753728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625829.364804:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625829.529611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625829.529672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625829.529713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625829.529770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695232 00000100:00100000:0.0:1788625829.529776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695360 00000100:00100000:3.0:1788625829.529786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695232 00000100:00100000:0.0:1788625829.529786:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695360 00000100:00100000:0.0:1788625829.529870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695488 00000100:00100000:0.0:1788625829.529874:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695488 00000100:00100000:0.0:1788625829.529902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:0.0:1788625829.529915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823695360:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625829.529940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 292 00000100:00100000:3.0:1788625829.529948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823695232:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:1.0:1788625829.530024:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625829.530045:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:1.0:1788625829.530056:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823695488:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625829.530186:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823695232:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 237us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625829.530216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 292 00000100:00100000:0.0:1788625829.534975:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823695360:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 5040us (5356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625829.535007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:1.0:1788625829.541391:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823695488:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 11317us (11656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625829.541412:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:0.0:1788625829.845290:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625829.845388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695616 00000100:00100000:3.0:1788625829.845401:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695616 00000100:00100000:3.0:1788625829.845489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1788625829.845501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10317:x1875509823695616:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625829.845881:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625829.845915:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb1399c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb7f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846018:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846036:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846050:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846067:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846080:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846356:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846376:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846382:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846388:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625829.846393:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846402:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846415:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:3.0:1788625829.846418:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625829.846423:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846429:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb139a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846443:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846449:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846455:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.846459:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625829.846468:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847299:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847314:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b4352039600) 00010000:00010000:3.0:1788625829.847318:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625829.847323:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847330:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb139aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847390:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb1399c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb7f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:3.0:1788625829.847404:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625829.847408:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb1399c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb7f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.847418:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6400, rc 0) 00000100:00100000:3.0:1788625829.847973:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10317:x1875509823695616:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2470us (2696us total) trans 0 rc 301/301 00000100:00100000:3.0:1788625829.847994:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1788625829.860867:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625829.861015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823695872 00000100:00100000:0.0:1788625829.861032:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823695872 00000100:00100000:0.0:1788625829.861115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1788625829.861127:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10317:x1875509823695872:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:0.0:1788625829.861200:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625829.861237:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13956 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb6a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861262:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:0.0:1788625829.861276:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625829.861568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861584:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861622:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861630:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.861637:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625829.862698:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788625829.862719:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862762:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862771:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862777:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625829.862783:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862793:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862812:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625829.862816:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625829.862821:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625829.862842:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb139b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625829.862868:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091e5b09a reply state 0000000072eeed7c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625829.862881:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625829.863060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:10317:x1875509823695872:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 1930us (2205us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788625829.863070:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00010000:00010000:3.0:1788625829.887681:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887706:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887756:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887762:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625829.887769:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887778:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887802:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b435917bf00) 00010000:00010000:3.0:1788625829.887806:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625829.887812:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625829.887819:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb139b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625829.951620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625829.951673:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696000 00000100:00100000:2.0:1788625829.951684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696000 00000100:00100000:2.0:1788625829.951766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1788625829.951777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:10325:x1875509823696000:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:2.0:1788625829.951809:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625829.951845:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb139bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb86 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.951926:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.951943:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.951957:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625829.952009:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788625829.952012:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625829.952058:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.952084:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb139bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb86 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.952106:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb86 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625829.952116:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:2.0:1788625829.952120:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625829.952123:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017200, rc 0) 00000100:00100000:2.0:1788625829.952187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:10325:x1875509823696000:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 413us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625829.952194:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625830.020023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.022286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696128 00000100:00100000:1.0:1788625830.022304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696128 00000100:00100000:1.0:1788625830.022557:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1788625830.022572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:10331:x1875509823696128:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1788625830.022599:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625830.022914:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb139cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb8d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023014:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023049:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023068:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023090:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023098:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023106:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023241:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023251:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023259:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625830.023293:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788625830.023298:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625830.023349:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023364:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023383:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023390:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023398:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.023403:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023412:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:1.0:1788625830.023431:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.023437:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023445:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb139d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023458:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023464:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023484:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023490:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.023500:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023508:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023517:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b4348a9fb00) 00010000:00010000:1.0:1788625830.023520:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.023533:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023540:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb139db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023577:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb139cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb8d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023592:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb8d expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.023600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625830.023603:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788625830.023606:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4ca00, rc 0) 00000100:00100000:1.0:1788625830.027889:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:10331:x1875509823696128:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5302us (7860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.027907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1788625830.039569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.039635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696384 00000100:00100000:2.0:1788625830.039649:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696384 00000100:00100000:2.0:1788625830.039723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1788625830.039781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:10331:x1875509823696384:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625830.039813:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625830.039846:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb139e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb94 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.040034:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.040056:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.040072:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.041474:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.041495:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.041506:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625830.042312:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788625830.042521:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042534:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042551:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042594:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042602:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042610:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042616:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625830.042621:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042629:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042643:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625830.042646:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625830.042651:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042658:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb139f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625830.042671:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080e845fd reply state 00000000b8236c09 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.042682:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788625830.042749:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb139e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042764:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.042772:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:2.0:1788625830.042774:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625830.042777:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016200, rc 0) 00000100:00100000:2.0:1788625830.042865:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10331:x1875509823696384:12345-192.168.201.45@tcp:101:bash.0 Request processed in 3089us (3312us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788625830.042874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00010000:00010000:1.0:1788625830.055445:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055481:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055509:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055516:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.055522:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055532:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055556:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43a00) 00010000:00010000:1.0:1788625830.055560:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.055566:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.055573:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb139f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625830.058016:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625830.061452:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696512 00000100:00100000:3.0:1788625830.061483:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696512 00000100:00100000:3.0:1788625830.061558:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1788625830.061570:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875509823696512:12345-192.168.201.45@tcp:8:bash.0 00010000:00080000:3.0:1788625830.061615:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:3.0:1788625830.061836:0:6698:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb13a0c 00002000:00100000:3.0:1788625830.061854:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b12515be-537a-4a8b-a2d2-568b1a5329ac/ffff9b4348a31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788625830.061887:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788625830.062234:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788625830.062288:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b4348a30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625830.062383:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823696512:12345-192.168.201.45@tcp:8:bash.0 Request processed in 813us (4384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625830.062392:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1788625830.076863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.077160:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696640 00000100:00100000:2.0:1788625830.077173:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696640 00000100:00100000:2.0:1788625830.077705:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1788625830.077719:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:0:x1875509823696640:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625830.077790:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625830.077826:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cb9b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625830.077861:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788625830.077886:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1788625830.077892:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625830.077904:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.077930:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.077962:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017800, rc 0) 00000100:00100000:2.0:1788625830.078055:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:0:x1875509823696640:12345-192.168.201.45@tcp:101:bash.0 Request processed in 338us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.078062:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00080000:1.0:1788625830.078933:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625830.082440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625830.083343:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696768 00000100:00100000:3.0:1788625830.083359:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696768 00000100:00100000:3.0:1788625830.083566:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1788625830.083582:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10331:x1875509823696768:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625830.083608:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625830.083637:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cba2 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.083678:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.083689:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625830.083695:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625830.083702:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.083786:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.083803:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 8 pid: 6696 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625830.083819:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875509845753856:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625830.083962:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625830.086635:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.086789:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823696896 00000100:00100000:1.0:1788625830.086802:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823696896 00010000:00010000:1.0:1788625830.086856:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 9 pid: 6696 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625830.086906:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:1.0:1788625830.086916:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2366:x1875509823696896:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625830.086935:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625830.086995:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 9 pid: 6696 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.087011:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 9 pid: 6696 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.087045:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625830.087050:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625830.087061:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.087072:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.087120:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625830.087138:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845753984:192.168.201.45@tcp:105: 00000100:00100000:1.0:1788625830.087242:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788625830.089079:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007aa33cc/0x8aede7274cb13a13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb9b expref: 9 pid: 6696 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625830.089107:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875509845753856:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625830.089146:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.089162:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6400, rc 0) 00000100:00100000:0.0:1788625830.089294:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:10331:x1875509823696768:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5714us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625830.089305:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1788625830.090212:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845753984:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625830.090229:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625830.090266:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823696896:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 3353us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.090275:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1788625830.094143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.094521:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823697152 00000100:00100000:1.0:1788625830.094537:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823697152 00000100:00100000:1.0:1788625830.094638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625830.094650:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10331:x1875509823697152:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1788625830.095200:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10331:x1875509823697152:12345-192.168.201.45@tcp:35:bash.0 Request processed in 549us (1070us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788625830.095210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00010000:00010000:2.0:1788625830.132777:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625830.198850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.199063:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823697408 00000100:00100000:1.0:1788625830.199078:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823697408 00000100:00100000:1.0:1788625830.199164:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1788625830.199177:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10341:x1875509823697408:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625830.199211:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625830.199241:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cba9 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625830.199381:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788625830.199561:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba9 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.199579:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:1.0:1788625830.199583:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625830.199823:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba9 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.199842:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c600, rc 0) 00000100:00100000:1.0:1788625830.199924:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10341:x1875509823697408:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 749us (1085us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788625830.199932:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1788625830.205771:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.206054:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823697664 00000100:00100000:0.0:1788625830.206067:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823697664 00000100:00100000:0.0:1788625830.206185:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1788625830.206196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10341:x1875509823697664:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1788625830.206620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10341:x1875509823697664:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 419us (980us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788625830.206629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1788625830.273609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.273883:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823697792 00000100:00100000:2.0:1788625830.273898:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823697792 00000100:00100000:2.0:1788625830.273998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1788625830.274022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10347:x1875509823697792:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625830.274054:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625830.274085:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13a2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbb0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274178:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274196:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274417:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625830.274466:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788625830.274469:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625830.274519:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274551:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13a2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274574:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb0 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.274583:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625830.274586:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625830.274591:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017e00, rc 0) 00000100:00100000:2.0:1788625830.274674:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:10347:x1875509823697792:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 667us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.274681:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1788625830.283331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.283936:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698048 00000100:00100000:1.0:1788625830.283967:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698048 00000100:00100000:1.0:1788625830.284074:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1788625830.284087:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:10347:x1875509823698048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625830.284115:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625830.284145:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb13a3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbb7 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.284491:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.284510:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.284525:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625830.284540:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788625830.284720:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb13a3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb7 expref: 20 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.284786:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb7 expref: 19 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.284797:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:1.0:1788625830.284800:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625830.284805:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c600, rc 0) 00000100:00100000:1.0:1788625830.284925:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10347:x1875509823698048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 841us (1610us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788625830.284934:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1788625830.290463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.290690:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698304 00000100:00100000:0.0:1788625830.290724:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698304 00000100:00100000:0.0:1788625830.290850:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:0.0:1788625830.290863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10347:x1875509823698304:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625830.290900:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625830.290932:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbbe expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.291507:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.291529:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.291545:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625830.291560:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788625830.293132:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbbe expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.293177:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbbe expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.293188:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:0.0:1788625830.293191:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788625830.293196:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625830.293517:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10347:x1875509823698304:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2652us (3245us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788625830.293528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:0.0:1788625830.300418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.300510:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.300621:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698432 00000100:00100000:2.0:1788625830.300636:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698432 00000100:00100000:2.0:1788625830.300713:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1788625830.300759:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823698432:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:2.0:1788625830.300834:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.300863:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.300873:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625830.300879:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625830.300893:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.300940:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.300956:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.300986:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1875509845754112:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625830.301103:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345619480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625830.301333:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698560 00000100:00100000:3.0:1788625830.301340:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698560 00000100:00100000:3.0:1788625830.301395:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1788625830.301404:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:2364:x1875509823698560:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625830.301418:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625830.301446:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb13a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb7 expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.301467:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:3.0:1788625830.301473:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625830.301517:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:2364:x1875509823698560:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 115us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625830.301526:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1788625830.305442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.306423:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1875509845754112:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625830.306473:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625830.306923:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698688 00000100:00100000:3.0:1788625830.306934:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698688 00002000:00100000:3.0:1788625830.307006:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b437b4a0a80 x1875509823698688/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:641/0 lens 504/0 e 0 to 0 dl 1788625841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625830.307044:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437b4a0a80 with x1875509823698688 ext(0->12) 00010000:00010000:3.0:1788625830.307055:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 8 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.307084:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 8 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625830.307093:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b437b4a0a80 00000100:00100000:3.0:1788625830.307123:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625830.307134:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823698688:12345-192.168.201.45@tcp:4:lfs.0 00000001:00100000:0.0:1788625830.348767:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000001:00080000:1.0:1788625830.412394:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788625830.414626:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823698688:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 107466us (109175us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788625830.414651:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:2.0:1788625830.414670:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b437b4a0a80 x1875509823698688/t4294967299(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:641/0 lens 504/448 e 0 to 0 dl 1788625841 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625830.414682:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437b4a0a80 with x1875509823698688 ext(0->12) 00010000:00010000:2.0:1788625830.414696:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.414720:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625830.414761:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b437b4a0a80 00000100:00100000:3.0:1788625830.421461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.421935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823698816 00000100:00100000:0.0:1788625830.421949:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823698816 00010000:00010000:0.0:1788625830.422025:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625830.422077:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:0.0:1788625830.422090:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823698816:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625830.422113:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788625830.422144:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788625830.422147:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788625830 00002000:00010000:0.0:1788625830.422150:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788625830 00002000:00010000:0.0:1788625830.422153:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788625830 00002000:00010000:0.0:1788625830.422155:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788625830.422163:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.422182:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.422224:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13a1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cba2 expref: 7 pid: 6698 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.422251:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625830.422274:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625830.422282:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.422587:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.423185:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625830.423279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823698816:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1188us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625830.423360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00010000:00010000:2.0:1788625830.429459:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.429919:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.429986:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.429997:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.430007:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.430016:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625830.430026:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.430038:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.430066:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.430110:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b9f64e/0x8aede7274cb13a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.430356:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823698432:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 129624us (130080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.430369:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1788625830.434143:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.434248:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699072 00000100:00100000:1.0:1788625830.434262:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699072 00000100:00100000:1.0:1788625830.434494:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1788625830.434508:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10347:x1875509823699072:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:1.0:1788625830.434597:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbbe expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625830.435050:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788625830.435114:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788625830.435965:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788625830.436889:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.436921:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.436932:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.437000:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.437137:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 24 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625830.437159:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db01500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875509845754240:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625830.437485:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea0f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625830.440940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.441116:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db01500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875509845754240:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625830.441152:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.441323:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699200 00000100:00100000:2.0:1788625830.441333:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699200 00010000:00010000:2.0:1788625830.441380:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 25 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.441421:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1788625830.441431:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:2365:x1875509823699200:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625830.441447:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625830.441455:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 25 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441468:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 25 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441496:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb139fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb94 expref: 25 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441514:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:2.0:1788625830.441519:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441547:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441555:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.441584:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625830.441650:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2365:x1875509823699200:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 221us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.441658:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00010000:00010000:1.0:1788625830.441877:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.441885:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625830.442076:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788625830.442353:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788625830.442517:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db01500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845754368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788625830.442585:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625830.442631:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625830.443519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845754368 00000100:00100000:2.0:1788625830.443533:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845754368 00000100:00100000:2.0:1788625830.443606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625830.443618:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845754368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625830.443758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845754368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 141us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.443766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625830.443836:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db01500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845754368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788625830.444922:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788625830.445061:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845754496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625830.445149:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625830.446576:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625830.446763:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625830.446933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845754496 00000100:00100000:2.0:1788625830.446946:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845754496 00000100:00100000:2.0:1788625830.447252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625830.447267:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845754496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625830.447713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875509845754496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 449us (2562us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788625830.447766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625830.447870:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845754496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788625830.447964:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788625830.448056:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448070:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448079:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448087:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625830.448099:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448109:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448130:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:3.0:1788625830.448134:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788625830.448140:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625830.448146:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13a6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625830.448401:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788625830.448687:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788625830.448702:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380444973180ns, next at 381444970036ns, rc = 0 00000001:00080000:3.0:1788625830.448710:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788625830.448809:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:3.0:1788625830.448814:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788625830.448823:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbbe expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625830.448987:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10347:x1875509823699072:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 14482us (14975us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788625830.448997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000020:00080000:3.0:1788625830.449004:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788625830.453135:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.453656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699328 00000100:00100000:0.0:1788625830.453673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699328 00000100:00100000:0.0:1788625830.453791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1788625830.453803:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10347:x1875509823699328:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625830.453835:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625830.453865:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbc5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.453947:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbc5 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.453964:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbc5 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.453997:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625830.454001:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625830.454031:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dae00, rc 0) 00000100:00100000:0.0:1788625830.454111:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:10347:x1875509823699328:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 310us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625830.454118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1788625830.457690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.458563:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699584 00000100:00100000:1.0:1788625830.458578:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699584 00000100:00100000:1.0:1788625830.458699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625830.458714:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eac8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:10347:x1875509823699584:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625830.459131:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eac8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10347:x1875509823699584:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 419us (1453us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788625830.459139:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1788625830.550356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.550574:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699840 00000100:00100000:2.0:1788625830.550588:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699840 00000100:00100000:2.0:1788625830.550669:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1788625830.550683:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10357:x1875509823699840:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625830.550719:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625830.550801:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbcc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625830.550925:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788625830.551499:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13a7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbcc expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.551522:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:2.0:1788625830.551525:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625830.551532:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbcc expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.551551:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016200, rc 0) 00000100:00100000:2.0:1788625830.551645:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10357:x1875509823699840:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 965us (1304us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788625830.551655:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1788625830.560915:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.561102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823699968 00000100:00100000:1.0:1788625830.561117:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823699968 00000100:00100000:1.0:1788625830.561221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1788625830.561235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10357:x1875509823699968:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:1.0:1788625830.561678:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561715:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561781:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561804:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561811:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561818:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561943:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561951:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.561959:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625830.562036:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562054:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562062:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562082:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562089:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.562094:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562105:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562120:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625830.562123:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.562129:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562136:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562151:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562157:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562163:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562168:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.562171:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562188:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562196:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4348a9fb00) 00010000:00010000:1.0:1788625830.562199:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.562202:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562210:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562228:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562234:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562240:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562246:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625830.562249:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562256:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562263:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625830.562266:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625830.562270:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625830.562697:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625830.563089:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10357:x1875509823699968:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1850us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.563101:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1788625830.566639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.566783:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823700224 00000100:00100000:1.0:1788625830.566796:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823700224 00000100:00100000:1.0:1788625830.566859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1788625830.566871:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10357:x1875509823700224:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625830.567423:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10357:x1875509823700224:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 552us (795us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788625830.567433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1788625830.638527:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.638778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823700480 00000100:00100000:2.0:1788625830.638791:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823700480 00000100:00100000:2.0:1788625830.638864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1788625830.638877:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10360:x1875509823700480:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625830.638932:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625830.638962:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbd3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639086:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639105:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639119:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639137:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639144:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639151:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639360:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639371:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639379:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625830.639391:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788625830.639518:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639527:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639535:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639544:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625830.639550:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639561:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639576:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625830.639579:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625830.639585:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639592:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639608:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639615:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639622:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639639:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625830.639643:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639650:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43a00) 00010000:00010000:2.0:1788625830.639661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625830.639664:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639671:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.639722:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.640270:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.640280:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625830.640283:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625830.640356:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016000, rc 0) 00000100:00100000:3.0:1788625830.640692:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10360:x1875509823700480:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1814us (2175us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788625830.640703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1788625830.644715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.644998:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823700608 00000100:00100000:2.0:1788625830.645018:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823700608 00000100:00100000:2.0:1788625830.645099:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625830.645112:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10360:x1875509823700608:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1788625830.645233:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645257:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645273:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645443:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645452:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645461:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645468:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625830.645474:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645484:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645498:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625830.645501:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625830.645507:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.645514:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625830.645627:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10360:x1875509823700608:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 516us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.645636:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:0.0:1788625830.661802:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.661929:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823700864 00000100:00100000:1.0:1788625830.661943:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823700864 00000100:00100000:1.0:1788625830.662024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625830.662037:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10360:x1875509823700864:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625830.662500:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10360:x1875509823700864:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 463us (713us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788625830.662508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625830.890887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625830.891446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823701120 00000100:00100000:0.0:1788625830.891459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823701120 00000100:00100000:0.0:1788625830.891537:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1788625830.891549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10391:x1875509823701120:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:0.0:1788625830.891581:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625830.891610:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbda expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.894711:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ad0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.894760:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.895561:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625830.895590:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788625830.895888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbda expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.895918:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbda expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625830.895969:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625830.895974:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625830.895979:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da800, rc 0) 00000100:00100000:0.0:1788625830.896093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10391:x1875509823701120:12345-192.168.201.45@tcp:101:cat.0 Request processed in 4543us (5218us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788625830.896104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1788625830.900022:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845754624:0@lo:400:kworker.0 00000100:00100000:3.0:1788625830.900119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625830.900186:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845755136:0@lo:400:kworker.0 00000100:00100000:3.0:1788625830.900229:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625830.900259:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625830.900266:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845754752:0@lo:400:kworker.0 00000100:00100000:3.0:1788625830.900462:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625830.900569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845754624 00000100:00100000:0.0:1788625830.900579:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845754624 00000100:00100000:0.0:1788625830.900636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788625830.900646:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845754624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625830.900717:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845754624:12345-0@lo:400:kworker.0 Request processed in 73us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625830.900725:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788625830.900824:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845754624:0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901038:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845755008:0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901078:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625830.901102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625830.901108:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845754880:0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901130:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625830.901178:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845755136 00000100:00100000:1.0:1788625830.901184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845755136 00000100:00100000:1.0:1788625830.901240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845754752 00000100:00100000:1.0:1788625830.901243:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845754752 00000100:00100000:1.0:1788625830.901257:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845754880 00000100:00100000:1.0:1788625830.901259:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845754880 00000100:00100000:1.0:1788625830.901273:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788625830.901444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845755136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901495:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845755136:12345-0@lo:400:kworker.0 Request processed in 214us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.901502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788625830.901517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625830.901523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901569:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845754752:12345-0@lo:400:kworker.0 Request processed in 46us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.901576:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625830.901587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788625830.901593:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845754880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901621:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845754880:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625830.901627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788625830.901644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625830.901669:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845754880:0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901699:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845754752:0@lo:400:kworker.0 00000100:00100000:1.0:1788625830.901711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845755136:0@lo:400:kworker.0 00000100:00100000:2.0:1788625830.901927:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845755008 00000100:00100000:2.0:1788625830.901933:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845755008 00000100:00100000:2.0:1788625830.901992:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625830.902000:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845755008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625830.902046:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845755008:12345-0@lo:400:kworker.0 Request processed in 47us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.902053:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625830.902079:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845755008:0@lo:400:kworker.0 00000100:00100000:3.0:1788625830.915470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625830.916277:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823701376 00000100:00100000:1.0:1788625830.925135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823701376 00000100:00100000:1.0:1788625830.925258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1788625830.925270:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10391:x1875509823701376:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:1.0:1788625830.925865:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:10391:x1875509823701376:12345-192.168.201.45@tcp:35:cat.0 Request processed in 593us (10677us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788625830.925876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1788625830.935499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625830.935550:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823701504 00000100:00100000:2.0:1788625830.935562:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823701504 00000100:00100000:2.0:1788625830.935642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1788625830.935654:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:2365:x1875509823701504:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625830.935676:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625830.935708:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ad0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbda expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625830.935754:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625830.935760:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625830.935834:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:2365:x1875509823701504:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 182us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625830.935842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000001:00080000:2.0:1788625831.010201:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967331 is committed 00000020:00080000:2.0:1788625831.010412:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b4350190a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788625831.010419:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b435db23600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b4350190300 00000020:00080000:2.0:1788625831.010423:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b435db23900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4356bba000 00000020:00080000:1.0:1788625831.010467:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788625831.010606:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:2.0:1788625831.010923:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788625831.011275:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625831.011412:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845755264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788625831.011512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625831.011713:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845755264 00000100:00100000:1.0:1788625831.011723:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845755264 00000100:00100000:1.0:1788625831.012066:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625831.012079:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845755264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788625831.012116:0:8805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788625831.012160:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c43a6, atime: 0x6a9c43a6, ctime: 0x6a9c43a6, blocks: 0xb 00010000:00010000:1.0:1788625831.012171:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.012193:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1788625831.012198:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625831.012207:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.012228:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.012240:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.012268:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.012298:0:8805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625831.012367:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625831.012376:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.012384:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625831.012389:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.012398:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.012431:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.012439:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb13ade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.012460:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625831.012462:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625831.012463:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625831.013079:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845755264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 999us (1563us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788625831.013089:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788625831.013264:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b435db02680/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788625831.013271:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845755264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788625831.036067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.036192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823701760 00000100:00100000:2.0:1788625831.036205:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823701760 00000100:00100000:2.0:1788625831.036303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625831.036317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10397:x1875509823701760:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:2.0:1788625831.036350:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625831.036354:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788625831.036393:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbb0 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.036417:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625831.036423:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625831.036441:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13ae5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbe1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.036560:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.036577:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.036588:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788625831.037037:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625831.037102:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.037121:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 13 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.037152:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845755392:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625831.037264:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625831.051386:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.055661:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845755392:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625831.055705:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625831.056177:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823701888 00000100:00100000:3.0:1788625831.056188:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823701888 00010000:00010000:0.0:1788625831.058126:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 14 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.058258:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625831.058272:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2366:x1875509823701888:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625831.058291:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625831.058299:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 14 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058314:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 14 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058343:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbd3 expref: 14 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058366:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625831.058371:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058404:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058413:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.058451:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625831.058527:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2366:x1875509823701888:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 258us (7156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625831.058534:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00010000:00010000:1.0:1788625831.061577:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.061600:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625831.061643:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788625831.062152:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13ae5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.062182:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.062193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.062196:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625831.062200:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016c00, rc 0) 00000100:00100000:1.0:1788625831.062308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10397:x1875509823701760:12345-192.168.201.45@tcp:101:dd.0 Request processed in 25994us (26254us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788625831.062339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625831.070254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.070356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823702144 00000100:00100000:1.0:1788625831.070371:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823702144 00000100:00100000:1.0:1788625831.070449:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1788625831.070462:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10397:x1875509823702144:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:1.0:1788625831.071312:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.071339:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.071356:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625831.071412:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788625831.071436:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c762077 reply state 000000002327992f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625831.071447:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625831.071569:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10397:x1875509823702144:12345-192.168.201.45@tcp:36:dd.0 Request processed in 1107us (1328us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788625831.071578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000020:00080000:1.0:1788625831.071585:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788625831.074286:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074306:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074314:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074321:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625831.074327:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074336:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074356:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625831.074360:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625831.074365:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.074396:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb13afa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.156254:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625831.306550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.306723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823702272 00000100:00100000:0.0:1788625831.307718:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823702272 00000100:00100000:0.0:1788625831.307861:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1788625831.307871:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10411:x1875509823702272:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:0.0:1788625831.307903:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625831.308693:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbe8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308832:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308858:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308871:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308876:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.308880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.309974:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.310010:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.310020:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.310069:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.310717:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 16 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.313905:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845755520:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625831.315432:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625831.325123:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.325351:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823702528 00000100:00100000:1.0:1788625831.325363:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823702528 00000100:00100000:1.0:1788625831.325449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625831.325461:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:5604:x1875509823702528:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788625831.325931:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845755520:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625831.326239:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625831.329493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:5604:x1875509823702528:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 4018us (4372us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788625831.329529:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625831.334926:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.335049:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823702656 00000100:00100000:2.0:1788625831.335067:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823702656 00010000:00010000:2.0:1788625831.335122:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 18 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625831.335185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1788625831.335195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:2365:x1875509823702656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625831.335211:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625831.335219:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 18 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335233:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 18 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335259:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13aec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe1 expref: 18 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335276:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625831.335282:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335293:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335330:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.335372:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625831.335431:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:2365:x1875509823702656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 237us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625831.335439:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00010000:00010000:1.0:1788625831.336193:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336208:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625831.336274:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788625831.336280:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625831.336362:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336382:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336394:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336402:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336409:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336415:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.336420:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336429:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336445:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625831.336456:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.336462:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336469:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336485:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336492:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336498:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336503:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.336505:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336512:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336520:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b435917b600) 00010000:00010000:1.0:1788625831.336523:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.336526:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336591:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe8 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336635:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe8 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.336643:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.336645:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625831.336648:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da000, rc 0) 00000100:00100000:1.0:1788625831.339661:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10411:x1875509823702272:12345-192.168.201.45@tcp:101:stat.0 Request processed in 28854us (30189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625831.339702:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1788625831.411941:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625831.411982:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845755648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625831.412767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625831.412862:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845755648 00000100:00100000:0.0:1788625831.412873:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845755648 00000100:00100000:0.0:1788625831.412934:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625831.412945:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845755648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625831.412987:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788625831.413214:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845755648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 270us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625831.413223:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625831.413287:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845755648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625831.431451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625831.431508:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823702912 00000100:00100000:3.0:1788625831.431522:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823702912 00000100:00100000:3.0:1788625831.431594:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:3.0:1788625831.431606:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10417:x1875509823702912:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:3.0:1788625831.431692:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625831.431876:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbe8 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.431900:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:3.0:1788625831.431907:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625831.432423:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.432458:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625831.432472:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625831.432535:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788625831.432562:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073d9bde2 reply state 000000000361fd69 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625831.432574:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625831.432726:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10417:x1875509823702912:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 1119us (1287us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788625831.433978:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000020:00080000:3.0:1788625831.433987:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788625831.435119:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435137:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435146:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435153:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.435160:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435170:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435191:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.435195:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.435201:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.435226:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13b1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625831.599972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.600233:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823703040 00000100:00100000:1.0:1788625831.600249:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823703040 00000100:00100000:1.0:1788625831.600344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:1.0:1788625831.600358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:10431:x1875509823703040:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:1.0:1788625831.600397:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625831.600428:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbef expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600564:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600583:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.600599:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.601702:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602412:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602432:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625831.602495:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788625831.602500:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625831.602528:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602542:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602552:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602560:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602567:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602575:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.602580:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602589:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602604:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625831.602618:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.602624:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602631:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602648:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602655:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602662:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602668:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.602671:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602678:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602685:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4348a9f600) 00010000:00010000:1.0:1788625831.602688:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.602691:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.602697:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.603644:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.603689:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.603697:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.603700:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625831.603703:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d600, rc 0) 00000100:00100000:1.0:1788625831.603831:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10431:x1875509823703040:12345-192.168.201.45@tcp:101:stat.0 Request processed in 3473us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625831.603842:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:3.0:1788625831.721599:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.722000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823703296 00000100:00100000:0.0:1788625831.722015:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823703296 00000100:00100000:0.0:1788625831.722102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1788625831.722114:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10442:x1875509823703296:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625831.722143:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625831.722173:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625831.722470:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788625831.722640:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13b40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbf6 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.722659:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:0.0:1788625831.722663:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625831.722670:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbf6 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.722690:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625831.723121:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10442:x1875509823703296:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1007us (1537us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788625831.723130:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1788625831.727902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.728374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823703552 00000100:00100000:2.0:1788625831.728388:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823703552 00000100:00100000:2.0:1788625831.728515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625831.728529:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10442:x1875509823703552:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625831.728905:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10442:x1875509823703552:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 376us (1016us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788625831.728914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1788625831.821519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.824513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823703808 00000100:00100000:0.0:1788625831.824567:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823703808 00000100:00100000:0.0:1788625831.824654:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:0.0:1788625831.824666:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10448:x1875509823703808:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625831.824707:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625831.824769:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13b4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cbfd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.824953:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.824971:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.824982:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.825028:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.825043:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 21 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.825059:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845755776:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625831.825611:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625831.830942:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.831065:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823703936 00000100:00100000:2.0:1788625831.831078:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823703936 00010000:00010000:2.0:1788625831.831144:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 22 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625831.831203:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1788625831.831222:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2365:x1875509823703936:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625831.831241:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625831.831525:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 22 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.831553:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 22 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.831604:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625831.831611:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.831623:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.831633:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.831658:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625831.831854:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2365:x1875509823703936:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 544us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625831.831862:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00010000:00010000:0.0:1788625831.832911:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb13b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbef expref: 21 pid: 5842 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.832938:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845755776:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625831.832994:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.833004:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.833010:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625831.833033:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788625831.833894:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13b4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.833925:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.833935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625831.833938:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625831.833942:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da600, rc 0) 00000100:00100000:0.0:1788625831.834039:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10448:x1875509823703808:12345-192.168.201.45@tcp:101:bash.0 Request processed in 9374us (12535us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788625831.834050:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1788625831.837600:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.838026:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823704192 00000100:00100000:2.0:1788625831.838044:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823704192 00000100:00100000:2.0:1788625831.838119:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1788625831.838132:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10448:x1875509823704192:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1788625831.838712:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.838837:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.838856:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625831.838920:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788625831.838967:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9f4327c reply state 000000005873ec19 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625831.838998:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625831.839500:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10448:x1875509823704192:12345-192.168.201.45@tcp:36:bash.0 Request processed in 1366us (1909us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788625831.839508:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000020:00080000:2.0:1788625831.839515:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788625831.848696:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.848721:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.848903:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.848912:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625831.848919:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.848929:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.849033:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.849037:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625831.849043:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.849074:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625831.849972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.850671:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823704320 00000100:00100000:1.0:1788625831.850685:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823704320 00000100:00100000:1.0:1788625831.850916:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1788625831.850929:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10448:x1875509823704320:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1788625831.853165:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625831.853314:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.853430:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.853453:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.853464:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.853507:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.853525:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 24 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625831.853542:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435db01880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845755904:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625831.853702:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625831.861608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625831.861698:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823704448 00000100:00100000:2.0:1788625831.861712:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823704448 00010000:00010000:2.0:1788625831.861987:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 25 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625831.862088:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1788625831.862101:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:2365:x1875509823704448:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625831.862120:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625831.862129:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 25 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.862145:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 25 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.862178:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625831.862185:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.862198:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.862207:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625831.862252:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625831.862327:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:2365:x1875509823704448:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 228us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625831.862336:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00010000:00010000:1.0:1788625831.862436:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbfd expref: 24 pid: 5843 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625831.862458:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435db01880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845755904:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625831.862663:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.862675:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.862682:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625831.862772:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788625831.862778:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625831.862820:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.862863:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc04 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.862879:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc04 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625831.862887:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625831.862890:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625831.862893:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4da00, rc 0) 00000100:00100000:1.0:1788625831.862940:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10448:x1875509823704320:12345-192.168.201.45@tcp:101:bash.0 Request processed in 12014us (12978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625831.862956:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1788625831.869143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.869222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823704704 00000100:00100000:1.0:1788625831.869235:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823704704 00000100:00100000:1.0:1788625831.869310:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1788625831.869323:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eacac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10448:x1875509823704704:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1788625831.869624:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eacac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10448:x1875509823704704:12345-192.168.201.45@tcp:35:bash.0 Request processed in 302us (496us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788625831.869632:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1788625831.985401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.985604:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823704960 00000100:00100000:0.0:1788625831.985618:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823704960 00000100:00100000:0.0:1788625831.985699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1788625831.985714:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10458:x1875509823704960:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625831.985815:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625831.985845:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc0b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625831.985987:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788625831.986162:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc0b expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.986181:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:0.0:1788625831.986185:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625831.986193:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc0b expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.986210:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db400, rc 0) 00000100:00100000:0.0:1788625831.986311:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:10458:x1875509823704960:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 599us (924us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788625831.986320:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:2.0:1788625831.991632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625831.991820:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823705088 00000100:00100000:0.0:1788625831.991836:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823705088 00000100:00100000:0.0:1788625831.991920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:0.0:1788625831.991931:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:10458:x1875509823705088:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:0.0:1788625831.992066:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.992092:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.992108:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.992147:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.992155:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.992162:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993402:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993422:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993433:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625831.993494:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993511:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993518:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993526:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993532:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625831.993537:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993554:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993568:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625831.993571:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625831.993577:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993585:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13b86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993601:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993607:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993612:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993618:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625831.993621:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993627:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993634:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b435917b200) 00010000:00010000:0.0:1788625831.993637:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625831.993640:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993657:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993676:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993683:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993690:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993695:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625831.993699:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993705:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993713:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625831.993716:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625831.993719:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625831.993725:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625831.994440:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:10458:x1875509823705088:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 2503us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625831.994452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:0.0:1788625831.997534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625831.997642:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823705344 00000100:00100000:1.0:1788625831.997656:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823705344 00000100:00100000:1.0:1788625831.997961:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625831.997976:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:10458:x1875509823705344:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625831.998558:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10458:x1875509823705344:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 582us (1035us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788625831.998568:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625832.041258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625832.041427:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823705600 00000100:00100000:0.0:1788625832.041440:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823705600 00000100:00100000:0.0:1788625832.041511:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1788625832.041521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10461:x1875509823705600:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625832.041549:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625832.041574:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc12 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041673:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041693:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041710:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041770:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041779:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.041786:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.042592:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.042603:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.042617:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625832.042627:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788625832.042723:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046098:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046111:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046118:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625832.046125:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046137:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625832.046167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625832.046174:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046181:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046210:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046216:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046248:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046253:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625832.046256:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046262:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046270:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b435917b200) 00010000:00010000:0.0:1788625832.046272:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625832.046275:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046281:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046380:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc12 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046398:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc12 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.046407:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625832.046409:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625832.046412:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625832.046527:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:10461:x1875509823705600:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 5005us (5284us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788625832.046546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:3.0:1788625832.053723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625832.053812:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625832.053997:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823705856 00000100:00100000:0.0:1788625832.054022:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823705856 00000100:00100000:0.0:1788625832.054106:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1788625832.054119:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:2365:x1875509823705856:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625832.054139:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625832.054178:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc12 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.054209:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625832.054217:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625832.054433:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:2365:x1875509823705856:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 315us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625832.054442:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1788625832.054830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823705728 00000100:00100000:1.0:1788625832.054838:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823705728 00000100:00100000:1.0:1788625832.054881:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:1.0:1788625832.054891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10461:x1875509823705728:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1788625832.054996:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055042:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055099:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055108:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055115:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055123:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625832.055129:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055138:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055163:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625832.055167:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625832.055172:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.055180:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625832.055238:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10461:x1875509823705728:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 348us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625832.055972:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1788625832.060175:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625832.060466:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823706112 00000100:00100000:2.0:1788625832.060492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823706112 00000100:00100000:2.0:1788625832.060558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1788625832.060569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10461:x1875509823706112:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625832.060904:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:10461:x1875509823706112:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 335us (744us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788625832.060913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00010000:00010000:2.0:1788625832.179105:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625832.211427:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625832.211635:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823706368 00000100:00100000:2.0:1788625832.211650:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823706368 00000100:00100000:2.0:1788625832.211769:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1788625832.211781:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:10479:x1875509823706368:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1788625832.211815:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625832.211855:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc19 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625832.212026:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13bcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625832.212050:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13bcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625832.212094:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13bcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625832.212119:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788625832.212537:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc19 expref: 31 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625832.212564:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13bcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc19 expref: 30 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625832.212575:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625832.212579:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788625832.212583:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017600, rc 0) 00000100:00100000:2.0:1788625832.212722:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10479:x1875509823706368:12345-192.168.201.45@tcp:101:cat.0 Request processed in 941us (1314us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788625832.213051:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:0.0:1788625832.240447:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625832.240701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823706496 00000100:00100000:1.0:1788625832.240713:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823706496 00000100:00100000:1.0:1788625832.240885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:1.0:1788625832.240912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10480:x1875509823706496:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625832.240984:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625832.241016:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc20 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241142:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625832.241209:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788625832.241214:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625832.241251:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241283:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc20 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241307:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc20 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.241317:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625832.241321:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625832.241325:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d000, rc 0) 00000100:00100000:1.0:1788625832.241410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10480:x1875509823706496:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 500us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625832.241427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:3.0:1788625832.254825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625832.254934:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823706880 00000100:00100000:2.0:1788625832.254961:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823706880 00000100:00100000:2.0:1788625832.255037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625832.255050:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10480:x1875509823706880:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625832.255515:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10480:x1875509823706880:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 467us (705us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788625832.255524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1788625832.258425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625832.259875:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707008 00000100:00100000:0.0:1788625832.259893:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707008 00000100:00100000:0.0:1788625832.260008:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1788625832.260021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10480:x1875509823707008:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:0.0:1788625832.260045:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788625832.260672:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc04 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.260710:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13bcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc19 expref: 31 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.262617:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cbc5 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625832.262632:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625832.262648:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625832.262753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10480:x1875509823707008:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 2708us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625832.262767:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1788625832.268605:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625832.268789:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707136 00000100:00100000:1.0:1788625832.268806:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707136 00000100:00100000:1.0:1788625832.268876:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:1.0:1788625832.268884:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10480:x1875509823707136:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:1.0:1788625832.269068:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.269432:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.269451:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788625832.271946:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625832.272348:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788625832.272431:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788625832.274464:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10480:x1875509823707136:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 5559us (5855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625832.274491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1788625832.351548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625832.353081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707264 00000100:00100000:1.0:1788625832.353451:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707264 00000100:00100000:1.0:1788625832.353627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:1.0:1788625832.353642:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10482:x1875509823707264:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625832.353672:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625832.353703:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb13bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc27 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353863:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353882:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353898:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.353947:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355759:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355782:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355795:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625832.355850:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788625832.355856:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625832.355883:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355911:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355922:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355929:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355949:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355956:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625832.355961:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355970:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.355984:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:1.0:1788625832.355988:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625832.355993:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356001:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13bf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356015:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356022:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356035:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356040:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625832.356043:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356050:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4348a9f000) 00010000:00010000:1.0:1788625832.356061:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625832.356064:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356069:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb13bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356642:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb13bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356664:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625832.356673:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:1.0:1788625832.356675:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625832.356678:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c000, rc 0) 00000100:00100000:1.0:1788625832.357069:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10482:x1875509823707264:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3426us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625832.357579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00010000:00010000:1.0:1788625833.204984:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625833.272527:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625833.272539:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625833.272604:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788625833.272617:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625833.272855:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845756032:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625833.273016:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625833.277894:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845756032:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625833.282623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.282719:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707392 00000100:00100000:1.0:1788625833.282818:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707392 00000100:00100000:1.0:1788625833.282898:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1788625833.282911:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707392:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788625833.283026:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707392:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 117us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.283035:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00080000:0.0:1788625833.283418:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625833.288398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.288472:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707520 00000100:00100000:2.0:1788625833.288485:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707520 00000100:00100000:2.0:1788625833.288558:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1788625833.288570:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707520:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625833.288611:0:6721:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625833.288769:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707520:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 201us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.288777:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:1.0:1788625833.298484:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.303335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707648 00000100:00100000:2.0:1788625833.303358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707648 00000100:00100000:2.0:1788625833.303440:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1788625833.303453:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707648:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788625833.303572:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303594:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303609:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303629:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303637:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303666:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303699:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303708:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303714:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625833.303804:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788625833.303809:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625833.303828:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303842:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303849:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303857:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303864:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625833.303870:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303878:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625833.303903:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625833.303909:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303917:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13c0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303953:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303959:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303965:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303970:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625833.303973:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303979:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303986:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b4356b43000) 00010000:00010000:2.0:1788625833.303989:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625833.303991:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.303998:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13c12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304035:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304041:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304047:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304052:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625833.304055:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304061:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304068:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:2.0:1788625833.304071:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625833.304074:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.304079:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13c19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.304416:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707648:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 961us (5944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.304427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1788625833.317433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.322895:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823707904 00000100:00100000:3.0:1788625833.322929:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823707904 00000100:00100000:3.0:1788625833.323020:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:3.0:1788625833.323034:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10493:x1875509823707904:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625833.323060:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625833.323088:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc2e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323227:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323246:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323261:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625833.323274:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788625833.323412:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323421:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323428:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323434:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625833.323440:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323459:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323476:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:3.0:1788625833.323479:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625833.323485:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323491:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323545:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c20 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc2e expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323556:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:3.0:1788625833.323558:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625833.323563:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc2e expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.323574:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:3.0:1788625833.323674:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823707904:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 644us (6257us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788625833.323682:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:3.0:1788625833.335342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.335436:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823708032 00000100:00100000:2.0:1788625833.335451:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823708032 00000100:00100000:2.0:1788625833.335528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:2.0:1788625833.335559:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823708032:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625833.335613:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625833.335802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823708032:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 245us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.335811:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:0.0:1788625833.350117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.350218:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823708288 00000100:00100000:3.0:1788625833.350231:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823708288 00000100:00100000:3.0:1788625833.350308:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:3.0:1788625833.350320:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823708288:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625833.350365:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625833.350369:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625833.350404:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb13be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc20 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.350428:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625833.350435:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625833.350453:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc35 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625833.351327:0:6721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788625833.351679:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.351699:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.351713:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.351825:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc35 expref: 33 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.351847:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc35 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.351857:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4352039600) 00010000:00010000:3.0:1788625833.351860:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625833.351872:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:3.0:1788625833.351977:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10493:x1875509823708288:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1658us (1873us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788625833.351987:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:0.0:1788625833.372665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625833.372715:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823708544 00000100:00100000:0.0:1788625833.372772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823708544 00000100:00100000:0.0:1788625833.372846:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:0.0:1788625833.372858:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10493:x1875509823708544:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625833.372953:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625833.372993:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc35 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.373020:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4352039600) 00010000:00010000:0.0:1788625833.373036:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625833.373073:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.373105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.373118:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374672:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374686:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374969:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374978:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374985:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.374991:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625833.374997:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375005:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375018:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625833.375030:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625833.375037:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375043:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13c4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375057:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375062:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375068:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375073:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625833.375075:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375082:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375090:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x26aae4a8 (ffff9b435917bc00) 00010000:00010000:0.0:1788625833.375094:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625833.375096:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.375101:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26aae4a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.375213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823708544:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 2351us (2557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625833.375232:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000040:00080000:2.0:1788625833.388925:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625833.388939:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625833.388987:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788625833.388995:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625833.393039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.393124:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823708672 00000100:00100000:1.0:1788625833.393139:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823708672 00000100:00100000:1.0:1788625833.393222:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:1.0:1788625833.393235:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10493:x1875509823708672:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625833.393267:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625833.393303:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc3c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393369:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393387:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393402:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393560:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb13c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 33 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393585:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.393597:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625833.393600:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625833.393605:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c400, rc 0) 00000100:00100000:1.0:1788625833.393687:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10493:x1875509823708672:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 455us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.393695:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1788625833.401786:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625833.401880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823708928 00000100:00100000:0.0:1788625833.401891:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823708928 00000100:00100000:0.0:1788625833.401999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1788625833.402018:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10493:x1875509823708928:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625833.402125:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.402146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.402174:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625833.402849:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788625833.402867:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383399137149ns, next at 384399133383ns, rc = 0 00000004:00010000:0.0:1788625833.403066:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f72bf72e reply state 000000000ab4b23c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.403079:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625833.403221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10493:x1875509823708928:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1204us (1448us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788625833.403236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00010000:00010000:3.0:1788625833.415011:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415030:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415038:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415046:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625833.415052:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415061:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415084:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:3.0:1788625833.415101:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625833.415108:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.415115:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13c66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.415368:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.415929:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709056 00000100:00100000:3.0:1788625833.415943:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709056 00000100:00100000:3.0:1788625833.416009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1788625833.416021:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10493:x1875509823709056:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625833.416069:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625833.416244:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc43 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.416337:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.416355:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.416380:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:3.0:1788625833.416384:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625833.416388:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625833.416483:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10493:x1875509823709056:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 464us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625833.416491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:0.0:1788625833.428240:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.430476:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709184 00000100:00100000:3.0:1788625833.430496:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709184 00000100:00100000:3.0:1788625833.430603:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1788625833.430614:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875509823709184:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788625833.430664:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:3.0:1788625833.430707:0:6697:0:(genops.c:1385:class_connect()) connect: client b12515be-537a-4a8b-a2d2-568b1a5329ac, cookie 0x8aede7274cb13c74 00002000:00100000:3.0:1788625833.430751:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b12515be-537a-4a8b-a2d2-568b1a5329ac/ffff9b4348a37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788625833.430787:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788625833.431146:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788625833.431202:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b4348a32000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625833.431304:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2362:x1875509823709184:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 Request processed in 690us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625833.431314:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1788625833.452044:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.452192:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709312 00000100:00100000:3.0:1788625833.452206:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709312 00000100:00100000:3.0:1788625833.452297:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1788625833.452309:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:0:x1875509823709312:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788625833.453373:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625833.520955:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:0:x1875509823709312:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 68630us (68908us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788625833.520974:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000001:00080000:1.0:1788625833.521031:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788625833.521045:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000100:00100000:3.0:1788625833.531770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625833.531872:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709568 00000100:00100000:0.0:1788625833.531888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709568 00000100:00100000:0.0:1788625833.531988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1788625833.532002:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10493:x1875509823709568:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625833.532347:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10493:x1875509823709568:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 348us (620us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788625833.532355:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1788625833.539546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.539632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709824 00000100:00100000:3.0:1788625833.539646:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709824 00000100:00100000:3.0:1788625833.539720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:3.0:1788625833.539764:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10493:x1875509823709824:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625833.539938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10493:x1875509823709824:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 178us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625833.539946:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:1.0:1788625833.550271:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.550408:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823709952 00000100:00100000:2.0:1788625833.550421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823709952 00000100:00100000:2.0:1788625833.550487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1788625833.550499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10493:x1875509823709952:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625833.550524:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625833.550550:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550644:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550662:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550678:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625833.550762:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625833.550790:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550853:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc4a expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550873:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc4a expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.550882:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625833.550885:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788625833.550890:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016c00, rc 0) 00000100:00100000:2.0:1788625833.550974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10493:x1875509823709952:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 477us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.550982:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:0.0:1788625833.556099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.556251:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710080 00000100:00100000:1.0:1788625833.556264:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710080 00000100:00100000:1.0:1788625833.556339:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:1.0:1788625833.556351:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823710080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625833.556375:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625833.556417:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc51 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625833.556468:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c43a9, blocks: 0x1 00010000:00010000:1.0:1788625833.556494:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1788625833.556499:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625833.556509:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.556537:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.556554:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4cc00, rc 0) 00000100:00100000:1.0:1788625833.556639:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823710080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 289us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.556648:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1788625833.560016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.560091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710336 00000100:00100000:3.0:1788625833.560105:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710336 00000100:00100000:3.0:1788625833.560181:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:3.0:1788625833.560193:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10493:x1875509823710336:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625833.560340:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10493:x1875509823710336:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 148us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625833.560348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1788625833.563348:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.563441:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710464 00000100:00100000:2.0:1788625833.563456:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710464 00000100:00100000:2.0:1788625833.563521:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1788625833.563532:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:10493:x1875509823710464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625833.563554:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625833.563580:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc58 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.563618:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.563629:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625833.563634:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625833.563648:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.563691:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.563707:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 7 pid: 6698 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.563759:0:8805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8805:1875509845756160:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625833.563864:0:8805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625833.567079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625833.567621:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710592 00000100:00100000:0.0:1788625833.567635:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710592 00010000:00010000:0.0:1788625833.567687:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 8 pid: 6698 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.567774:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1788625833.567786:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823710592:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625833.567806:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625833.568007:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 8 pid: 6698 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.568026:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 8 pid: 6698 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.568057:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625833.568062:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625833.568074:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.568097:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.568150:0:7642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.568169:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7642:1875509845756288:192.168.201.45@tcp:105: 00000100:00100000:0.0:1788625833.568322:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5ccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788625833.568863:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb13c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc51 expref: 8 pid: 6698 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.568883:0:8805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8805:1875509845756160:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625833.568926:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.568941:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017800, rc 0) 00000100:00100000:1.0:1788625833.568981:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10493:x1875509823710464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 5451us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.568997:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1788625833.577201:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.577256:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710720 00000100:00100000:2.0:1788625833.577269:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710720 00002000:00100000:2.0:1788625833.577334:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b43798c9c00 x1875509823710720/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:644/0 lens 504/0 e 0 to 0 dl 1788625844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625833.577347:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43798c9c00 with x1875509823710720 ext(0->8) 00002000:00010000:2.0:1788625833.577355:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43798c9c00 00000100:00100000:2.0:1788625833.577397:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1788625833.577409:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823710720:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788625833.579783:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7642:1875509845756288:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625833.579835:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625833.579939:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823710592:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 12153us (12867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.579952:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1788625833.582025:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823710720:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 4604us (4827us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788625833.582042:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:2.0:1788625833.582060:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b43798c9c00 x1875509823710720/t4294967302(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:644/0 lens 504/448 e 0 to 0 dl 1788625844 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625833.582085:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43798c9c00 with x1875509823710720 ext(0->8) 00002000:00010000:2.0:1788625833.582092:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43798c9c00 00000100:00100000:3.0:1788625833.585794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.586161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710848 00000100:00100000:2.0:1788625833.586174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710848 00000100:00100000:2.0:1788625833.586241:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:2.0:1788625833.586255:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10493:x1875509823710848:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788625833.670796:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788625833.670822:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788625833.670865:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788625833.670949:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788625833.670966:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788625833.671111:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625833.671139:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845756416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788625833.671247:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625833.671310:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845756416 00000100:00100000:1.0:1788625833.671320:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845756416 00000100:00100000:1.0:1788625833.671400:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625833.671413:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845756416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788625833.671527:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10493:x1875509823710848:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 85271us (85739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.671538:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00002000:00010000:1.0:1788625833.671616:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788625833.671621:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788625833 00002000:00010000:1.0:1788625833.671623:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788625833.671626:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788625833 -> 1788625833 00002000:00010000:1.0:1788625833.671628:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788625833.671760:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845756416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 349us (512us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788625833.671768:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788625833.672088:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788625833.672457:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b437b4a1500/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788625833.672467:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845756416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788625833.676250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.676932:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823710976 00000100:00100000:1.0:1788625833.676947:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823710976 00000100:00100000:1.0:1788625833.677017:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1788625833.677028:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823710976:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788625833.722453:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788625833.722501:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788625833.722800:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823710976:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 45764us (46556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625833.722814:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:3.0:1788625833.726428:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625833.727090:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823711232 00000100:00100000:0.0:1788625833.727107:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823711232 00000100:00100000:0.0:1788625833.727228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1788625833.727241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10493:x1875509823711232:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625833.727316:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625833.727352:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc4a expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.727379:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625833.727385:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625833.727444:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.727462:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625833.727474:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625833.727897:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f169e252 reply state 00000000896f8af2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.727905:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625833.728186:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10493:x1875509823711232:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 946us (1781us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788625833.728195:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00010000:00010000:1.0:1788625833.731610:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731634:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731643:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731649:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.731656:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731665:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731688:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625833.731692:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625833.731698:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.731704:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13c97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625833.734079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.734876:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823711360 00000100:00100000:1.0:1788625833.734892:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823711360 00000100:00100000:1.0:1788625833.734980:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1788625833.734993:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823711360:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788625833.735359:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788625833.735363:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788625833 -> 1788625831 00002000:00010000:1.0:1788625833.735366:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788625830 00002000:00010000:1.0:1788625833.735369:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788625833 -> 1788625831 00002000:00010000:1.0:1788625833.735371:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788625833.735467:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823711360:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 475us (1400us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788625833.735476:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1788625833.738593:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.738667:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823711616 00000100:00100000:1.0:1788625833.738682:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823711616 00000100:00100000:1.0:1788625833.738883:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1788625833.738898:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10493:x1875509823711616:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788625833.739017:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.739040:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 13 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.739052:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.739240:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 13 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.739259:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 13 pid: 6721 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.739304:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845756544:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625833.739455:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43413779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625833.741867:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845756544:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625833.741904:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625833.742861:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.743025:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823711744 00000100:00100000:2.0:1788625833.743036:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823711744 00010000:00010000:2.0:1788625833.743096:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 14 pid: 6721 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.743150:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:2.0:1788625833.743162:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2365:x1875509823711744:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625833.743183:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625833.743191:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 14 pid: 6721 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743207:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 14 pid: 6721 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743273:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb13c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc3c expref: 14 pid: 6721 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743295:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625833.743300:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743311:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743320:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.743353:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625833.743389:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743397:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.743420:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823711744:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 261us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.743428:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00010000:00010000:1.0:1788625833.743433:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743440:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743447:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743455:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.743460:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743468:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743479:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625833.743489:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788625833.743494:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.743501:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb13c9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.743547:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:10493:x1875509823711616:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 4653us (4968us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788625833.743556:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1788625833.745836:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.745952:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823711872 00000100:00100000:2.0:1788625833.745965:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823711872 00000100:00100000:2.0:1788625833.746074:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1788625833.746095:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823711872:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788625833.746164:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.746192:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.746237:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625833.746242:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625833.746248:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.746296:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.746314:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.746331:0:8805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8805:1875509845756672:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625833.746420:0:8805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625833.750099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625833.750194:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712000 00000100:00100000:3.0:1788625833.750205:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712000 00010000:00010000:3.0:1788625833.750263:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625833.750311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1788625833.750322:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823712000:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625833.750339:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625833.750367:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.750383:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 8 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.750415:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625833.750420:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625833.750430:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.750443:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.750495:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625833.750570:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823712000:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 249us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625833.750578:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00010000:00010000:2.0:1788625833.752806:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007aa33cc/0x8aede7274cb13c90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc58 expref: 7 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.752831:0:8805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8805:1875509845756672:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625833.752873:0:8805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752887:0:8805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752894:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752969:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752980:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752989:0:8805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.752997:0:8805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625833.753001:0:8805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.753011:0:8805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.753036:0:8805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.753044:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dca798/0x8aede7274cb13ca5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.753156:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823711872:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 7070us (7331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.753168:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1788625833.760277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625833.760389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712256 00000100:00100000:1.0:1788625833.760402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712256 00000100:00100000:1.0:1788625833.760473:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:1.0:1788625833.760486:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:10493:x1875509823712256:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788625833.760590:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.760612:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.760628:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.760945:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.760958:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.760969:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.761022:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.761039:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 13 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.761057:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845756800:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625833.761167:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43413779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625833.763503:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845756800:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625833.763545:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625833.764420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.764528:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712384 00000100:00100000:2.0:1788625833.764538:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712384 00010000:00010000:2.0:1788625833.764589:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 14 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.764627:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1788625833.764638:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2365:x1875509823712384:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625833.764656:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625833.764664:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 14 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764679:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 14 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764707:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc43 expref: 14 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764771:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625833.764777:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764789:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764798:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.764819:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625833.764885:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823712384:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 247us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.764920:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00010000:00010000:1.0:1788625833.765032:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.765042:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625833.765301:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788625833.765483:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788625833.765538:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788625833.765645:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875509845756928:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788625833.765713:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625833.765806:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625833.766016:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845756928 00000100:00100000:0.0:1788625833.766025:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845756928 00000100:00100000:0.0:1788625833.766075:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625833.766085:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875509845756928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788625833.766181:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875509845756928:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625833.766188:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625833.766653:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788625833.766660:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b437b4a1500, transno 4294967303 00000100:00100000:1.0:1788625833.766677:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875509845756928:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788625833.767445:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788625833.767533:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379977480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875509845757056:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788625833.767606:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625833.767639:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4341377300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625833.767661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757056 00000100:00100000:0.0:1788625833.767669:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757056 00000100:00100000:0.0:1788625833.767724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625833.767858:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875509845757056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788625833.768220:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875509845757056:12345-0@lo:1000:mdt00_002.0 Request processed in 365us (612us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788625833.768229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625833.768316:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379977480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875509845757056:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788625833.768356:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768364:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768371:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768375:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.768379:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768385:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625833.768405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625833.768409:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb13cb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768454:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768468:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768474:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768479:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.768482:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768488:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:1.0:1788625833.768500:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625833.768503:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768509:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb13be8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768531:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768547:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768555:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768580:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.768599:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 16 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.768610:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845757184:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625833.768686:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625833.771109:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845757184:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625833.771111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1788625833.771145:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.771227:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712512 00000100:00100000:2.0:1788625833.771236:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712512 00010000:00010000:2.0:1788625833.771276:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 17 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625833.771310:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1788625833.771317:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:2366:x1875509823712512:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625833.771331:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625833.771336:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 17 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771346:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 17 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771367:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb13c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc27 expref: 17 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771380:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:2.0:1788625833.771384:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771393:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771399:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.771437:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625833.771505:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:2366:x1875509823712512:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 186us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625833.771513:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00010000:00010000:1.0:1788625833.771681:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771689:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771704:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771718:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771757:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771765:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.771769:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771778:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771797:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:1.0:1788625833.771800:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625833.771804:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771812:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb13cba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771824:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771831:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771837:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771841:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625833.771844:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771850:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771858:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4348a9f600) 00010000:00010000:1.0:1788625833.771860:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625833.771863:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625833.771868:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb13cac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625833.772226:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10493:x1875509823712256:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 11741us (11962us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788625833.772237:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000020:00080000:1.0:1788625833.772242:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788625833.772664:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625833.772671:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625833.772706:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788625833.772717:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625833.774573:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625833.774623:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712768 00000100:00100000:2.0:1788625833.774636:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712768 00000100:00100000:2.0:1788625833.774701:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1788625833.774710:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10493:x1875509823712768:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788625833.775550:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788625833.775638:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788625833.775679:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775697:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775708:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775716:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775723:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775776:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625833.775794:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625833.775833:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625833.775841:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.775848:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625833.775852:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.775861:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.775875:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b4356b43a00) 00010000:00010000:3.0:1788625833.775878:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788625833.775884:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.775889:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13cc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625833.775922:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625833.775924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625833.775928:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:10493:x1875509823712768:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1202us (1345us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1788625833.775933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625833.775938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000020:00080000:2.0:1788625833.775944:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788625834.227915:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625834.483111:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625834.483149:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845757312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625834.483253:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625834.487448:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757312 00000100:00100000:1.0:1788625834.487468:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757312 00000100:00100000:1.0:1788625834.487574:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625834.487588:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845757312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625834.487626:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788625834.487781:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845757312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (4527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625834.487788:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625834.487882:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845757312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625834.666377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625834.666427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625834.666466:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713024 00000100:00100000:0.0:1788625834.666479:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713024 00000100:00100000:2.0:1788625834.666623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823712896 00000100:00100000:2.0:1788625834.666628:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823712896 00000100:00100000:2.0:1788625834.666668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 294 00000100:00100000:2.0:1788625834.666680:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823712896:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625834.666813:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823712896:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 135us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625834.666822:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 294 00000100:00100000:0.0:1788625834.667032:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:0.0:1788625834.667041:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:2363:x1875509823713024:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625834.667083:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:2363:x1875509823713024:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625834.667090:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:1.0:1788625834.682207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625834.682248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625834.682286:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713280 00000100:00100000:1.0:1788625834.682299:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713280 00000100:00100000:1.0:1788625834.682362:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713152 00000100:00100000:1.0:1788625834.682364:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713152 00000100:00100000:1.0:1788625834.682388:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:1.0:1788625834.682399:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823713280:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625834.682480:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823713280:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625834.682488:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:1.0:1788625834.682503:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1788625834.682523:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823713152:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625834.682560:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823713152:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625834.682566:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1788625834.682612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00080000:0.0:1788625834.683670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625834.683714:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713408 00000100:00100000:0.0:1788625834.683766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713408 00000100:00100000:0.0:1788625834.683846:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:0.0:1788625834.683857:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823713408:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625834.683936:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823713408:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 81us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625834.683944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00080000:0.0:1788625834.683964:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625835.255472:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625835.499270:0:12067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625835.499284:0:12067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625835.499329:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788625835.499337:0:12067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788625835.681704:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1788625835.720413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625835.720481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713664 00000100:00100000:0.0:1788625835.720496:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713664 00000100:00100000:0.0:1788625835.720592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:0.0:1788625835.720606:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:10512:x1875509823713664:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625835.720636:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625835.720666:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc5f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.720857:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ccf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.720887:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ccf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.720906:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ccf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625835.720922:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788625835.721469:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc5f expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.721504:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ccf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc5f expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788625835.721935:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625835.722487:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625835.722491:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625835.722497:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da800, rc 0) 00000100:00100000:0.0:1788625835.722624:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10512:x1875509823713664:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2019us (2221us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788625835.722635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1788625835.728151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625835.728960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823713792 00000100:00100000:0.0:1788625835.728997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823713792 00000100:00100000:0.0:1788625835.729084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1788625835.729097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10512:x1875509823713792:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:0.0:1788625835.729216:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729239:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729255:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729275:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729282:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729290:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729628:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729638:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.729646:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625835.729717:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733653:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733664:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733675:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733681:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625835.733687:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733697:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733721:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625835.733724:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625835.733748:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733755:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733778:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733784:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733789:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733801:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625835.733805:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733812:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733822:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b435917b200) 00010000:00010000:0.0:1788625835.733825:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625835.733829:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733834:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733858:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733864:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733870:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733888:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dae00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625835.733891:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733898:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:0.0:1788625835.733920:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625835.733923:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.733930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625835.734261:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10512:x1875509823713792:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 5158us (6116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625835.734274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1788625835.820632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625835.820802:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823714048 00000100:00100000:3.0:1788625835.820817:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823714048 00000100:00100000:3.0:1788625835.822312:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:3.0:1788625835.822337:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:10515:x1875509823714048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625835.822368:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625835.822401:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822513:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822533:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822547:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822567:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822575:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.822583:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823026:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823036:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625835.823050:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788625835.823197:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823206:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823215:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823221:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625835.823226:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823235:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823249:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625835.823253:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625835.823259:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823266:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13cf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823280:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823294:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823301:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823306:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625835.823309:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823316:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823325:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4352039800) 00010000:00010000:3.0:1788625835.823328:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625835.823331:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823337:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823393:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823409:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.823418:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:3.0:1788625835.823420:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625835.823429:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625835.823522:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10515:x1875509823714048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1195us (2905us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788625835.823531:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1788625835.840011:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625835.844805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823714176 00000100:00100000:3.0:1788625835.844829:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823714176 00000100:00100000:3.0:1788625835.844947:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:3.0:1788625835.844961:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10515:x1875509823714176:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1788625835.845058:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845081:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845096:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845340:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845350:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845358:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845365:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625835.845371:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845380:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845417:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:3.0:1788625835.845420:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625835.845426:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.845432:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625835.845548:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10515:x1875509823714176:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 590us (5550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625835.845556:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:3.0:1788625835.847530:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625835.847622:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823714432 00000100:00100000:0.0:1788625835.847636:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823714432 00000100:00100000:0.0:1788625835.847718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1788625835.847755:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eacb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10515:x1875509823714432:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1788625835.848091:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eacb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:10515:x1875509823714432:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 362us (574us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788625835.848100:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1788625835.898007:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625835.907023:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823714688 00000100:00100000:3.0:1788625835.907045:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823714688 00000100:00100000:3.0:1788625835.907125:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:3.0:1788625835.907139:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:10034:x1875509823714688:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625835.907172:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625835.907202:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc6d expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.907341:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.907361:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.907374:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.907438:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.907454:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 23 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625835.907472:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845757440:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625835.907789:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625835.919282:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625835.919427:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823714816 00000100:00100000:2.0:1788625835.919442:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823714816 00010000:00010000:2.0:1788625835.919510:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625835.919568:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1788625835.919580:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2365:x1875509823714816:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625835.919600:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625835.919609:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625835.919624:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625835.919653:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625835.919676:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625835.919689:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625835.919698:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625835.919723:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625835.919836:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2365:x1875509823714816:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 258us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625835.919844:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00010000:00010000:1.0:1788625835.920382:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13d07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc66 expref: 23 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625835.920407:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845757440:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625835.920443:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.920456:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.920463:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625835.920504:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788625835.921665:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13d1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.922086:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.922100:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:1.0:1788625835.922104:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625835.922231:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:1.0:1788625835.922331:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10034:x1875509823714688:12345-192.168.201.45@tcp:101:bash.0 Request processed in 15194us (24337us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788625835.922340:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:1.0:1788625835.933661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625835.934017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715072 00000100:00100000:3.0:1788625835.934031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715072 00000100:00100000:3.0:1788625835.934102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:3.0:1788625835.934114:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10034:x1875509823715072:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1788625835.934515:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.934538:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.934554:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625835.934619:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788625835.934646:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a8a5dac reply state 00000000492b498d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625835.934658:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788625835.934714:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788625835.934989:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10034:x1875509823715072:12345-192.168.201.45@tcp:36:bash.0 Request processed in 874us (1339us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788625835.935007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000020:00080000:3.0:1788625835.935012:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788625835.940669:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:3.0:1788625835.940824:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940842:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940852:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940859:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625835.940865:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940886:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940911:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:3.0:1788625835.940915:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625835.940922:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625835.940930:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625835.941122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715200 00000100:00100000:0.0:1788625835.941138:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715200 00000100:00100000:0.0:1788625835.941203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1788625835.941215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10034:x1875509823715200:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625835.941245:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625835.941269:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.941383:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13d38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc74 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.941401:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13d38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc74 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625835.941428:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:0.0:1788625835.941431:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625835.941434:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625835.941518:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10034:x1875509823715200:12345-192.168.201.45@tcp:101:bash.0 Request processed in 304us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625835.941525:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:2.0:1788625835.948852:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625835.949044:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715328 00000100:00100000:1.0:1788625835.949057:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715328 00000100:00100000:1.0:1788625835.949150:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1788625835.949162:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:10034:x1875509823715328:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1788625835.949184:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625835.949210:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc7b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625835.949243:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c43a7, atime: 0x6a9c43a6, ctime: 0x6a9c43a7, blocks: 0xb 00010000:00010000:1.0:1788625835.949271:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1788625835.949276:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625835.949285:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.949328:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625835.949344:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4ce00, rc 0) 00000100:00100000:1.0:1788625835.949416:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10034:x1875509823715328:12345-192.168.201.45@tcp:101:bash.0 Request processed in 257us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625835.949423:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00080000:0.0:1788625835.950281:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625835.959279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625835.959371:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715456 00000100:00100000:2.0:1788625835.959385:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715456 00002000:00010000:2.0:1788625835.959440:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788625835.959445:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43801ed880 with x1875509823715456 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625835.959462:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43801ed880. 00000100:00100000:2.0:1788625835.959500:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1788625835.959511:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823715456:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:2.0:1788625835.960084:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788625835.960089:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788625831 -> 1788625836 00002000:00010000:2.0:1788625835.960092:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788625830 -> 1788625830 00002000:00010000:2.0:1788625835.960094:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788625831 -> 1788625836 00002000:00010000:2.0:1788625835.960097:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788625835.960216:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823715456:12345-192.168.201.45@tcp:10:bash.0 Request processed in 704us (951us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788625835.960243:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00010000:2.0:1788625835.960248:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788625835.960251:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43801ed880 with x1875509823715456 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625835.960256:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43801ed880. 00000100:00100000:0.0:1788625836.019994:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625836.020192:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845757824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625836.020291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625836.020368:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625836.020373:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845757696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625836.020406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625836.020439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757824 00000100:00100000:3.0:1788625836.020448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757824 00000100:00100000:3.0:1788625836.020507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757696 00000100:00100000:3.0:1788625836.020509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757696 00000100:00100000:3.0:1788625836.020531:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625836.020541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845757824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625836.020598:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845757824:12345-0@lo:400:kworker.0 Request processed in 58us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625836.020606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625836.020627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788625836.020633:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845757696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625836.020654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845757696:12345-0@lo:400:kworker.0 Request processed in 21us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625836.020660:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788625836.020714:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845757696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625836.020749:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845757824:0@lo:400:kworker.0 00000100:00080000:2.0:1788625836.020912:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625836.021211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845757952:0@lo:400:kworker.0 00000100:00100000:0.0:1788625836.021254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625836.021294:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845757568:0@lo:400:kworker.0 00000100:00100000:0.0:1788625836.021323:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625836.021360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757568 00000100:00100000:0.0:1788625836.021366:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757568 00000100:00100000:0.0:1788625836.021395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788625836.021401:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625836.021435:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845757568:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.021454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788625836.021489:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845757568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625836.021564:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845757952 00000100:00100000:2.0:1788625836.021568:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845757952 00000100:00100000:2.0:1788625836.021614:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625836.021621:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845757952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625836.021660:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845757952:12345-0@lo:400:kworker.0 Request processed in 41us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.021666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625836.021709:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845757952:0@lo:400:kworker.0 00000100:00080000:0.0:1788625836.022128:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625836.022306:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625836.022316:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845758208:0@lo:400:kworker.0 00000100:00100000:0.0:1788625836.022352:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625836.022413:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625836.022421:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845758080:0@lo:400:kworker.0 00000100:00100000:2.0:1788625836.022448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625836.022515:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845758080 00000100:00100000:0.0:1788625836.022521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845758080 00000100:00100000:0.0:1788625836.022570:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788625836.022577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845758080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625836.022613:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845758080:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.022619:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788625836.022666:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625836.022686:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788625836.022995:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845758208 00000100:00100000:1.0:1788625836.023001:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845758208 00000100:00100000:1.0:1788625836.023049:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625836.023057:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845758208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625836.023106:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845758208:12345-0@lo:400:kworker.0 Request processed in 50us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625836.023112:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625836.023139:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788625836.023146:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788625836.023167:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b435db02680, transno 4294967301 00000100:00100000:1.0:1788625836.023179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845758208:0@lo:400:kworker.0 00000100:00080000:2.0:1788625836.023555:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625836.120573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.120783:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715584 00000100:00100000:2.0:1788625836.120798:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715584 00000100:00100000:2.0:1788625836.121154:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:2.0:1788625836.121169:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10529:x1875509823715584:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1788625836.121285:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121332:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121352:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121375:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121383:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121390:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121979:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.121992:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122002:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625836.122063:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122078:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122086:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122107:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122114:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.122118:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122128:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122144:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625836.122148:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.122155:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122163:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122180:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122187:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122193:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122198:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.122201:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122217:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122226:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43300) 00010000:00010000:2.0:1788625836.122228:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.122232:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122237:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122255:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122262:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122268:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122274:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.122277:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122284:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122291:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625836.122293:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.122296:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.122311:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.122588:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10529:x1875509823715584:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1416us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.122610:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:0.0:1788625836.178475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.179188:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715840 00000100:00100000:3.0:1788625836.179205:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715840 00000100:00100000:3.0:1788625836.179288:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:3.0:1788625836.179303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:10532:x1875509823715840:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625836.179333:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625836.179363:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179496:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179515:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179529:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179548:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.179564:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182485:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182528:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625836.182546:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788625836.182683:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182692:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182712:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182719:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625836.182772:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182783:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182799:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625836.182803:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625836.182809:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182816:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182835:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182843:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182849:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182855:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625836.182858:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182885:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182894:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4352039800) 00010000:00010000:3.0:1788625836.182896:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625836.182900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc82 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.182994:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc82 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.183002:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:3.0:1788625836.183005:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788625836.183008:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6400, rc 0) 00000100:00100000:3.0:1788625836.183117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10532:x1875509823715840:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3816us (4657us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788625836.183129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:1.0:1788625836.186228:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625836.186354:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823715968 00000100:00100000:0.0:1788625836.186369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823715968 00000100:00100000:0.0:1788625836.186457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1788625836.186471:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10532:x1875509823715968:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1788625836.186577:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.186610:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 29 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.186622:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.186710:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 29 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.187006:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 29 pid: 6721 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625836.187028:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845758336:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625836.187149:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625836.200172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625836.200354:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845758336:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625836.200397:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.200463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823716224 00000100:00100000:3.0:1788625836.200474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823716224 00000100:00100000:3.0:1788625836.200591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1788625836.200614:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:5603:x1875509823716224:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788625836.201353:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:5603:x1875509823716224:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 735us (1190us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788625836.201364:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1788625836.212642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.212881:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823716352 00000100:00100000:2.0:1788625836.212897:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823716352 00010000:00010000:2.0:1788625836.212954:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 31 pid: 6721 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.213110:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1788625836.213132:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:2365:x1875509823716352:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625836.213158:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625836.213167:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 31 pid: 6721 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213184:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 31 pid: 6721 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213218:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13d23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc6d expref: 31 pid: 6721 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213239:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625836.213245:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213272:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213282:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.213321:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625836.213404:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:2365:x1875509823716352:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 282us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.213412:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00010000:00010000:0.0:1788625836.213481:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213490:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213531:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213539:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213547:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213554:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625836.213560:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213581:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213602:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:0.0:1788625836.213605:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625836.213610:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.213617:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625836.213665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10532:x1875509823715968:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 27197us (27453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.213673:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:1.0:1788625836.216555:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.216942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823716608 00000100:00100000:2.0:1788625836.216958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823716608 00000100:00100000:2.0:1788625836.217079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1788625836.217092:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:10532:x1875509823716608:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625836.217456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10532:x1875509823716608:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 365us (912us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788625836.217466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00010000:00010000:2.0:1788625836.276795:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625836.340580:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625836.347990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823716864 00000100:00100000:0.0:1788625836.348012:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823716864 00000100:00100000:3.0:1788625836.348243:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:3.0:1788625836.348262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:10543:x1875509823716864:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1788625836.348298:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625836.348327:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc89 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348431:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348449:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348464:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348482:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348489:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.348496:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350225:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350267:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625836.350284:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788625836.350425:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350447:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350455:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350462:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.350468:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350478:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350493:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625836.350497:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.350506:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350513:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350530:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350536:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350541:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350546:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.350555:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350562:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350570:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4352039800) 00010000:00010000:2.0:1788625836.350572:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.350575:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.350581:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.353087:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc89 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.353461:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc89 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.353473:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625836.353476:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625836.353481:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016c00, rc 0) 00000100:00100000:2.0:1788625836.353609:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10543:x1875509823716864:12345-192.168.201.45@tcp:101:cat.0 Request processed in 5351us (13041us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788625836.353620:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1788625836.368011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.368228:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823717120 00000100:00100000:3.0:1788625836.368244:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823717120 00000100:00100000:3.0:1788625836.368355:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1788625836.368370:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10543:x1875509823717120:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:3.0:1788625836.369328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10543:x1875509823717120:12345-192.168.201.45@tcp:35:cat.0 Request processed in 952us (1323us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788625836.369341:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1788625836.416967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.417113:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823717376 00000100:00100000:2.0:1788625836.417130:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823717376 00000100:00100000:2.0:1788625836.417217:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:2.0:1788625836.417230:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10544:x1875509823717376:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:2.0:1788625836.417336:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788625836.417375:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13d9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc89 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417405:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc82 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417423:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc74 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417437:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625836.417451:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625836.417483:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417505:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417518:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417541:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417549:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.417556:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.418295:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.418309:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.418319:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625836.419288:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788625836.419304:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386415574296ns, next at 387415571254ns, rc = 0 00010000:00010000:2.0:1788625836.419380:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419395:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419407:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419417:0:6721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419424:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419431:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419458:0:6721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625836.419490:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419505:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419513:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419519:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.419524:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419534:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419548:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43000) 00010000:00010000:2.0:1788625836.419552:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788625836.419558:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419565:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13db6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419587:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419609:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419615:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419621:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.419632:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419639:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419648:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625836.419651:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.419654:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.419661:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13da8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.419988:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625836.419998:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.420006:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625836.420010:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.420017:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.420027:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b4356b43000) 00010000:00010000:0.0:1788625836.420030:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788625836.420041:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.420047:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13dbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.420067:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625836.420069:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625836.420071:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788625836.420249:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fe988e3 reply state 000000004ae55419 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.420262:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625836.420450:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:10544:x1875509823717376:12345-192.168.201.45@tcp:36:rm.0 Request processed in 3216us (3780us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788625836.420462:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00010000:00010000:0.0:1788625836.427092:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427127:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427136:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427144:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625836.427151:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427161:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427184:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43300) 00010000:00010000:0.0:1788625836.427188:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625836.427195:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.427203:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13daf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625836.523189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.523671:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823717632 00000100:00100000:3.0:1788625836.523687:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823717632 00000100:00100000:2.0:1788625836.524293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:2.0:1788625836.524314:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:10550:x1875509823717632:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625836.524351:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625836.524389:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13dc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc90 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524565:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524586:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524621:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524642:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524649:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.524656:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625836.526503:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788625836.526798:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526817:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526892:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526901:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526909:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526916:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.526934:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526944:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526959:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625836.526963:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.526968:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.526976:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13dcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625836.526994:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e070707 reply state 00000000ba90fb7d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.527005:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788625836.527052:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13dc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.527070:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.527079:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:2.0:1788625836.527082:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625836.527085:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016000, rc 0) 00000100:00100000:2.0:1788625836.527567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10550:x1875509823717632:12345-192.168.201.45@tcp:101:bash.0 Request processed in 3259us (4392us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788625836.527579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:0.0:1788625836.531209:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625836.531241:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845758464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625836.531319:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625836.532014:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532029:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532038:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532044:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625836.532051:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532060:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532083:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43e00) 00010000:00010000:3.0:1788625836.532087:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625836.532092:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.532099:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13dd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.534808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.534877:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823717760 00000100:00100000:2.0:1788625836.534891:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823717760 00000100:00100000:2.0:1788625836.534973:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:2.0:1788625836.534986:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823717760:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625836.535011:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625836.535046:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc97 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625836.535080:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788625836.535118:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788625836.535124:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625836.535138:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.535162:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.535177:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017600, rc 0) 00000100:00100000:2.0:1788625836.535255:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823717760:12345-192.168.201.45@tcp:101:bash.0 Request processed in 271us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.535264:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00080000:2.0:1788625836.535291:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625836.543043:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845758464 00000100:00100000:1.0:1788625836.543592:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845758464 00000100:00100000:1.0:1788625836.543819:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625836.543833:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845758464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625836.543925:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625836.544052:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845758464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (12733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625836.544059:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625836.544175:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845758464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625836.546619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.546720:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823717888 00000100:00100000:3.0:1788625836.546751:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823717888 00000100:00100000:3.0:1788625836.546837:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:3.0:1788625836.546851:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:10550:x1875509823717888:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625836.546887:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625836.546915:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cc9e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.546959:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.546970:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625836.546976:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625836.546983:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.547031:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.547050:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 7 pid: 6696 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.547069:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875509845758592:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625836.547211:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625836.554242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.554410:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823718016 00000100:00100000:2.0:1788625836.554426:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823718016 00010000:00010000:2.0:1788625836.554506:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 8 pid: 6696 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.554562:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625836.554575:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823718016:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625836.554598:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625836.554633:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 8 pid: 6696 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.554651:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 8 pid: 6696 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.554706:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625836.554713:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625836.554724:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.554783:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.554850:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.554881:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845758720:192.168.201.45@tcp:105: 00000100:00100000:2.0:1788625836.555003:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4243042e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788625836.555835:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27674fc/0x8aede7274cb13de7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc97 expref: 8 pid: 6696 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.555885:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875509845758592:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625836.555920:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.555936:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6400, rc 0) 00000100:00100000:3.0:1788625836.556003:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:10550:x1875509823717888:12345-192.168.201.45@tcp:101:bash.0 Request processed in 9155us (9400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625836.556012:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:2.0:1788625836.559454:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845758720:192.168.201.45@tcp:105: 00010000:00010000:2.0:1788625836.559511:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625836.559591:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823718016:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 5016us (5363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.559605:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1788625836.567674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.568189:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823718272 00000100:00100000:2.0:1788625836.568204:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823718272 00000100:00100000:2.0:1788625836.568292:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1788625836.568305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:10550:x1875509823718272:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1788625836.570071:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10550:x1875509823718272:12345-192.168.201.45@tcp:35:bash.0 Request processed in 1754us (2407us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788625836.570090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1788625836.801108:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625836.801309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823718400 00000100:00100000:0.0:1788625836.801321:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823718400 00000100:00100000:0.0:1788625836.801388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1788625836.801396:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:10567:x1875509823718400:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625836.801425:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625836.801450:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cca5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801523:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801536:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801548:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625836.801584:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788625836.801588:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625836.801612:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cca5 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801868:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cca5 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.801880:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625836.801884:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625836.801889:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da600, rc 0) 00000100:00100000:0.0:1788625836.802016:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10567:x1875509823718400:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 619us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.802026:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1788625836.805158:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.805404:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823718656 00000100:00100000:3.0:1788625836.805422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823718656 00000100:00100000:3.0:1788625836.805497:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:3.0:1788625836.805536:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:10567:x1875509823718656:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625836.805567:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625836.805607:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccac expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.805808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.805828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.805842:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625836.805854:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788625836.806086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccac expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.806124:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccac expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.806136:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:3.0:1788625836.806139:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625836.806144:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7400, rc 0) 00000100:00100000:3.0:1788625836.806510:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:10567:x1875509823718656:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 976us (1362us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788625836.806520:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:1.0:1788625836.810953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.811173:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823718784 00000100:00100000:3.0:1788625836.811187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823718784 00000100:00100000:3.0:1788625836.811337:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:3.0:1788625836.811352:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:2365:x1875509823718784:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625836.811376:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625836.811410:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccac expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.811433:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:3.0:1788625836.811439:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625836.811512:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:2365:x1875509823718784:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 164us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625836.811520:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625836.816609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.816782:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719040 00000100:00100000:2.0:1788625836.816797:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719040 00000100:00100000:0.0:1788625836.816946:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:0.0:1788625836.816964:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:10567:x1875509823719040:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625836.816998:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625836.817038:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccb3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.817199:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.817221:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.817235:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625836.817250:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788625836.817445:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccb3 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.817479:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccb3 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.817489:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:0.0:1788625836.817492:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788625836.817499:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dbe00, rc 0) 00000100:00100000:0.0:1788625836.817586:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:10567:x1875509823719040:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 627us (1001us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788625836.817593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:0.0:1788625836.824354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.824564:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719168 00000100:00100000:2.0:1788625836.824576:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719168 00000100:00100000:2.0:1788625836.824689:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1788625836.824703:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823719168:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:2.0:1788625836.824815:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.824840:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.824847:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625836.824851:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625836.824866:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.824930:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.824943:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 6 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.824959:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1875509845758848:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625836.825065:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4243042900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625836.828315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.828611:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1875509845758848:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625836.828653:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.829061:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719296 00000100:00100000:3.0:1788625836.829075:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719296 00002000:00100000:3.0:1788625836.829255:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b4342c71180 x1875509823719296/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:647/0 lens 504/0 e 0 to 0 dl 1788625847 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625836.829267:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4342c71180 with x1875509823719296 ext(0->8) 00010000:00010000:3.0:1788625836.829278:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 7 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.829296:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 7 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625836.829305:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b4342c71180 00000100:00100000:3.0:1788625836.829437:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1788625836.829451:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823719296:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1788625836.830261:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2366:x1875509823719296:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 807us (1954us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788625836.830272:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00100000:3.0:1788625836.830283:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b4342c71180 x1875509823719296/t4294967302(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:647/0 lens 504/448 e 0 to 0 dl 1788625847 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625836.830294:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4342c71180 with x1875509823719296 ext(0->8) 00010000:00010000:3.0:1788625836.830303:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.830321:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625836.830341:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b4342c71180 00000100:00100000:1.0:1788625836.839447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625836.839590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719424 00000100:00100000:0.0:1788625836.839604:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719424 00010000:00010000:0.0:1788625836.839661:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625836.839767:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1788625836.839780:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2363:x1875509823719424:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625836.839802:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788625836.839834:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788625836.839838:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788625836 00002000:00010000:0.0:1788625836.839841:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788625836 00002000:00010000:0.0:1788625836.839843:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788625836 00010000:00010000:0.0:1788625836.839852:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.839927:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.839962:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69514c2/0x8aede7274cb13dee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc9e expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.839986:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625836.839991:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625836.839998:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.840009:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625836.840057:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625836.840128:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2363:x1875509823719424:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 351us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.840137:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00010000:00010000:1.0:1788625836.840780:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840795:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840831:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840838:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840844:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840869:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625836.840875:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840886:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840903:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625836.840912:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074dca798/0x8aede7274cb13e2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625836.840994:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823719168:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 16293us (16664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625836.841001:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1788625836.844939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625836.845144:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719680 00000100:00100000:3.0:1788625836.845159:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719680 00000100:00100000:3.0:1788625836.845238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1788625836.845250:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eac8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:10567:x1875509823719680:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:3.0:1788625836.845342:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccb3 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625836.845687:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788625836.845783:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788625836.848389:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788625836.848598:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.848627:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.848639:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.848922:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.848946:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 42 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.848969:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875509845758976:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625836.849302:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625836.859871:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.860109:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719808 00000100:00100000:2.0:1788625836.860125:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719808 00010000:00010000:2.0:1788625836.860185:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 43 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.860253:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625836.860267:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:2366:x1875509823719808:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625836.860288:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625836.860297:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 43 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.860314:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 43 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.860369:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:2.0:1788625836.860375:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.860388:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.860398:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.860429:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625836.860673:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13dd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc90 expref: 43 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625836.860711:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875509845758976:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625836.860766:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.860780:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625836.860787:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625836.861004:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788625836.861292:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788625836.861450:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845759104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625836.861884:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+44:2366:x1875509823719808:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1614us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.861898:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1788625836.862530:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625836.862594:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43502d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625836.863182:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845759104 00000100:00100000:0.0:1788625836.863200:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845759104 00000100:00100000:0.0:1788625836.863285:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625836.863298:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845759104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788625836.863451:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845759104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625836.863479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625836.864045:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845759104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788625836.864931:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788625836.865179:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845759232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788625836.865257:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625836.865291:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43502d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625836.865478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845759232 00000100:00100000:0.0:1788625836.865489:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845759232 00000100:00100000:0.0:1788625836.865550:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625836.865560:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875509845759232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788625836.865865:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875509845759232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 296us (597us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788625836.865875:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625836.866002:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875509845759232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788625836.866116:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788625836.866172:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866186:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866197:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866205:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.866211:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866241:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866264:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:2.0:1788625836.866268:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788625836.866275:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.866283:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13e34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625836.866524:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788625836.866685:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788625836.866701:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386862971063ns, next at 387862968550ns, rc = 0 00000001:00080000:2.0:1788625836.866708:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788625836.866797:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43600) 00010000:00010000:2.0:1788625836.866802:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788625836.866812:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccb3 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.866956:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eac8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:10567:x1875509823719680:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 21707us (22030us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788625836.866967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000020:00080000:2.0:1788625836.866972:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788625836.873414:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.873512:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823719936 00000100:00100000:2.0:1788625836.873527:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823719936 00000100:00100000:2.0:1788625836.873610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1788625836.873623:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:10567:x1875509823719936:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625836.873694:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625836.873777:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13e3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccba expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.873887:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13e3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccba expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.873906:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13e3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccba expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.873933:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625836.873936:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625836.873943:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371017800, rc 0) 00000100:00100000:2.0:1788625836.874417:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+46:10567:x1875509823719936:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 793us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.874426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:1.0:1788625836.877992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.878243:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823720192 00000100:00100000:2.0:1788625836.878260:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823720192 00000100:00100000:2.0:1788625836.878373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1788625836.878387:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+46:10567:x1875509823720192:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625836.878804:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:10567:x1875509823720192:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 418us (827us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788625836.878813:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1788625836.984262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625836.984473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823720320 00000100:00100000:2.0:1788625836.984487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823720320 00000100:00100000:2.0:1788625836.984577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:2.0:1788625836.984599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:10577:x1875509823720320:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1788625836.984798:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.984824:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.984839:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.984869:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.984878:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.984885:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985024:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985032:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985038:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625836.985100:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985119:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985138:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985145:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985152:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.985158:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985168:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985182:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625836.985186:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.985193:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985199:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985216:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985222:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985229:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985235:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.985244:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985251:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985260:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43600) 00010000:00010000:2.0:1788625836.985264:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.985267:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985274:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13e49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985292:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985299:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985305:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985310:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625836.985313:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985319:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985327:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625836.985329:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625836.985339:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625836.985345:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625836.985445:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:10577:x1875509823720320:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 847us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625836.985454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:1.0:1788625837.059413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.059698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823720576 00000100:00100000:3.0:1788625837.059714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823720576 00000100:00100000:3.0:1788625837.059877:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:3.0:1788625837.059896:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:10580:x1875509823720576:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625837.059938:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625837.059984:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccc1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788625837.060227:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788625837.060483:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060505:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060523:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060551:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060559:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060945:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.060953:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625837.060968:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788625837.061225:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061235:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061263:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625837.061268:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061278:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061294:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625837.061298:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625837.061305:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061312:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13e5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061332:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061339:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061345:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061351:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625837.061354:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061371:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061379:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4352039d00) 00010000:00010000:3.0:1788625837.061381:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625837.061384:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061453:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc1 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061469:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc1 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.061477:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625837.061479:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625837.061481:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:3.0:1788625837.061668:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+49:10580:x1875509823720576:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1767us (2264us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788625837.061677:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1788625837.072318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.072424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823720704 00000100:00100000:2.0:1788625837.072442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823720704 00000100:00100000:2.0:1788625837.072531:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:2.0:1788625837.072544:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+49:10580:x1875509823720704:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1788625837.072650:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072677:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072694:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072863:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072873:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072882:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072917:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.072923:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072933:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072951:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.072954:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625837.072961:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.072968:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.073084:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+49:10580:x1875509823720704:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 541us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.073093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:0.0:1788625837.086202:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.086454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823720960 00000100:00100000:3.0:1788625837.086470:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823720960 00000100:00100000:3.0:1788625837.086551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1788625837.086567:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+49:10580:x1875509823720960:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1788625837.087174:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:10580:x1875509823720960:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 607us (984us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788625837.087183:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1788625837.219946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625837.220495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823721216 00000100:00100000:0.0:1788625837.220511:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823721216 00000100:00100000:0.0:1788625837.220599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:0.0:1788625837.220611:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:10590:x1875509823721216:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625837.220645:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625837.220649:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788625837.220825:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cca5 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.220848:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625837.220864:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625837.220891:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccc8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.221046:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.221091:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.221104:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625837.221120:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788625837.221510:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13e81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc8 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.221530:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc8 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.221538:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625837.221541:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625837.221543:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dae00, rc 0) 00000100:00100000:0.0:1788625837.222048:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:10590:x1875509823721216:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1436us (2117us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788625837.222059:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1788625837.227076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.227242:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823721472 00000100:00100000:2.0:1788625837.227257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823721472 00000100:00100000:2.0:1788625837.227339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:2.0:1788625837.227361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:10590:x1875509823721472:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1788625837.227495:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788625837.227531:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc8 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.227558:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccc1 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.227587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.227595:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625837.227957:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.227975:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.227988:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625837.228051:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788625837.228077:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2a240d9 reply state 00000000326bae06 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.228100:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625837.228222:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:10590:x1875509823721472:12345-192.168.201.45@tcp:36:bash.0 Request processed in 863us (1163us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788625837.228231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000020:00080000:2.0:1788625837.228237:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625837.231913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.231986:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823721600 00000100:00100000:3.0:1788625837.232000:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823721600 00000100:00100000:3.0:1788625837.232094:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:3.0:1788625837.232106:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:10590:x1875509823721600:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625837.232143:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625837.232175:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cccf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.232286:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.232302:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.232312:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.232335:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.232358:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233499:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233516:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233524:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233529:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.233556:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233563:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233630:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.233633:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.233636:0:3295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233645:0:3295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233651:0:3295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233690:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.233698:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13e96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.233758:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.233767:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625837.233825:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788625837.233830:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625837.233925:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.233960:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13e9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.233973:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.233979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625837.233981:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625837.233983:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625837.234079:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:10590:x1875509823721600:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1973us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625837.234314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:1.0:1788625837.236867:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.236939:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823721856 00000100:00100000:2.0:1788625837.236953:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823721856 00000100:00100000:2.0:1788625837.237030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1788625837.237045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:10590:x1875509823721856:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1788625837.237556:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+53:10590:x1875509823721856:12345-192.168.201.45@tcp:35:bash.0 Request processed in 514us (713us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788625837.237565:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:1.0:1788625837.294496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.294614:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823721984 00000100:00100000:2.0:1788625837.294658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823721984 00000100:00100000:2.0:1788625837.294788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:2.0:1788625837.294801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+53:10596:x1875509823721984:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625837.294837:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625837.294879:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.294969:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.294984:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.294996:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625837.295040:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788625837.295045:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625837.295067:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.295107:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017e00/0x8aede7274cb13eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccd6 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.295132:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccd6 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.295144:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625837.295148:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625837.295153:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4371016000, rc 0) 00000100:00100000:2.0:1788625837.295249:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823721984:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 450us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.295257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:1.0:1788625837.299642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.299817:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823722112 00000100:00100000:2.0:1788625837.299832:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823722112 00000100:00100000:2.0:1788625837.299926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:2.0:1788625837.299940:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823722112:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625837.299971:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625837.300005:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccdd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625837.300088:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625837.300237:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300259:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300274:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300293:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300299:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300303:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300580:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300587:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625837.300637:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788625837.300641:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625837.300844:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300874:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300884:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300891:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300899:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300905:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.300910:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300919:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625837.300938:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.300951:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300958:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017600/0x8aede7274cb13ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300975:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300981:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300986:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.300991:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.300994:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301000:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4356b43600) 00010000:00010000:2.0:1788625837.301010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.301013:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301020:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016c00/0x8aede7274cb13ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301064:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016200/0x8aede7274cb13eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301838:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.301845:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.301847:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625837.301860:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94ae00, rc 0) 00000100:00100000:2.0:1788625837.301986:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10596:x1875509823722112:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2045us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.301998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:1.0:1788625837.316128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625837.316245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.316286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823722368 00000100:00100000:2.0:1788625837.316302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823722368 00000100:00100000:2.0:1788625837.316397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:2.0:1788625837.316411:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10596:x1875509823722368:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625837.316446:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625837.316477:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cce4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316644:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316685:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316697:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316723:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316824:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.316844:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.316873:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845759360:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625837.317012:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.317022:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 56 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.317030:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845759488:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625837.317058:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4243042240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625837.318763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823722496 00000100:00100000:0.0:1788625837.318782:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823722496 00010000:00010000:0.0:1788625837.318844:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 57 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625837.318894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1788625837.318907:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:2366:x1875509823722496:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625837.318927:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625837.318951:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 57 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.318969:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 57 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.319001:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625837.319008:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.319019:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.319027:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625837.319716:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:2366:x1875509823722496:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 804us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625837.319760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1788625837.338047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625837.338621:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823722624 00000100:00100000:0.0:1788625837.338634:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823722624 00010000:00010000:0.0:1788625837.338712:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 57 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625837.338802:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1788625837.338815:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:2366:x1875509823722624:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625837.338834:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625837.338842:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 57 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.338871:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 57 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.338929:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625837.338936:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.338950:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.338959:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.338989:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625837.339066:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:2366:x1875509823722624:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 253us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625837.339085:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00010000:00010000:2.0:1788625837.339538:0:5841:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.45@tcp) returned -22 from blocking AST (req@0000000062ef5465 x1875509845759360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.339555:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccdd expref: 56 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.339581:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845759360:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625837.339612:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cccf expref: 55 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.339624:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845759488:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625837.339665:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.339897:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.339908:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.339915:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625837.339942:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788625837.340303:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.340327:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.340337:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.340644:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625837.340657:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a600, rc 0) 00000100:00100000:2.0:1788625837.342550:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10596:x1875509823722368:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 26125us (26424us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788625837.342565:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:1.0:1788625837.348013:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.348454:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823722880 00000100:00100000:2.0:1788625837.348567:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823722880 00000100:00100000:2.0:1788625837.348865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1788625837.348883:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10596:x1875509823722880:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1788625837.348904:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625837.348941:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017800/0x8aede7274cb13e3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccba expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.348968:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.348976:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625837.349059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823722880:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 182us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.349081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1788625837.357275:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.357602:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723008 00000100:00100000:3.0:1788625837.357618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723008 00000100:00100000:3.0:1788625837.357925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:3.0:1788625837.357940:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823723008:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:3.0:1788625837.358151:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.358176:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.358193:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625837.358472:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788625837.358877:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823723008:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 937us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625837.358887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:0.0:1788625837.362303:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.363077:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723136 00000100:00100000:3.0:1788625837.365858:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723136 00000100:00100000:2.0:1788625837.366347:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:2.0:1788625837.366363:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:10596:x1875509823723136:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625837.366393:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625837.366423:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cceb expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366507:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366521:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366551:0:6721:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366592:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366610:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.366614:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625837.366618:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.366627:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94aa00, rc 0) 00000100:00100000:2.0:1788625837.366946:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10596:x1875509823723136:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 585us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.366955:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 111 00000040:00080000:2.0:1788625837.875155:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625837.875170:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625837.875220:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788625837.875228:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625837.875405:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845759616:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625837.875566:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4243042840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625837.900901:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845759616:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625837.906023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.906687:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723264 00000100:00100000:3.0:1788625837.906702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723264 00000100:00100000:3.0:1788625837.906805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:3.0:1788625837.906817:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10597:x1875509823723264:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788625837.906884:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788625837.907065:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10597:x1875509823723264:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 248us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625837.907074:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:0.0:1788625837.914408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.914724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723392 00000100:00100000:2.0:1788625837.914778:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723392 00000100:00100000:2.0:1788625837.914862:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:2.0:1788625837.915044:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10597:x1875509823723392:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788625837.915153:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915200:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915216:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915235:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915242:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915249:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915280:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915288:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915295:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625837.915346:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788625837.915351:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625837.915369:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915384:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915402:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915411:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915418:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ae00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.915424:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915434:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915449:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625837.915452:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.915459:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915467:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb13ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915491:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915498:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915511:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.915519:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915527:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915535:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b4356b43600) 00010000:00010000:2.0:1788625837.915538:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.915541:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915548:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13eff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915566:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915572:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915577:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915582:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94bc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.915585:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915591:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915600:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625837.915602:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.915611:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.915618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.915788:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:10597:x1875509823723392:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 747us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625837.924209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.924365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723648 00000100:00100000:3.0:1788625837.924379:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723648 00000100:00100000:3.0:1788625837.924450:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:3.0:1788625837.924462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823723648:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625837.924490:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625837.924517:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccf2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.924648:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.924667:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.924817:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625837.924832:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788625837.925083:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925092:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925101:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925107:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625837.925113:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925122:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925138:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625837.925142:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625837.925148:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925155:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925212:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f0d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccf2 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925238:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:3.0:1788625837.925241:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625837.925246:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccf2 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.925258:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7200, rc 0) 00000100:00100000:3.0:1788625837.925396:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:10597:x1875509823723648:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 934us (1201us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788625837.925404:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:2.0:1788625837.927975:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:1.0:1788625837.948995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.949147:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823723776 00000100:00100000:2.0:1788625837.949159:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823723776 00000100:00100000:2.0:1788625837.949236:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:2.0:1788625837.949249:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823723776:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625837.949297:0:6721:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625837.949435:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823723776:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 187us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.949444:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:1.0:1788625837.957798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.958118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724032 00000100:00100000:3.0:1788625837.958133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724032 00000100:00100000:3.0:1788625837.958215:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:3.0:1788625837.958228:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823724032:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625837.958259:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625837.958264:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625837.958304:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371016000/0x8aede7274cb13eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccd6 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.958331:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625837.958338:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625837.958357:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ccf9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625837.963377:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788625837.963696:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.963769:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.963786:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.963927:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccf9 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.963957:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccf9 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.963969:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:3.0:1788625837.963972:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625837.963978:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625837.964072:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:10597:x1875509823724032:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 5845us (6291us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788625837.964084:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:1.0:1788625837.967636:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625837.967926:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724288 00000100:00100000:2.0:1788625837.967941:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724288 00000100:00100000:2.0:1788625837.968014:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:2.0:1788625837.968027:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:10597:x1875509823724288:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625837.968120:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625837.968156:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ccf9 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968181:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:2.0:1788625837.968194:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625837.968223:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968263:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968276:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968294:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968302:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968309:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968403:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968412:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968420:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968425:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94bc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.968431:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968439:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968448:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:2.0:1788625837.968458:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.968463:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968470:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb13f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968480:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968488:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968494:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968500:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625837.968503:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968509:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968516:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeb1eb9d8 (ffff9b4356b43600) 00010000:00010000:2.0:1788625837.968519:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625837.968521:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.968527:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb1eb9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625837.968988:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823724288:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 959us (1365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625837.969004:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:1.0:1788625837.973550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625837.973652:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724416 00000100:00100000:0.0:1788625837.973666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724416 00000100:00100000:0.0:1788625837.973793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:0.0:1788625837.973806:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:10597:x1875509823724416:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625837.973847:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625837.973886:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13f45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd00 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.973942:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.973961:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625837.973998:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.974414:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb13f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.974441:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625837.974454:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625837.974458:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625837.974463:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da600, rc 0) 00000100:00100000:2.0:1788625837.974551:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:10597:x1875509823724416:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 747us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625837.974559:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:1.0:1788625837.977855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.978158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724672 00000100:00100000:3.0:1788625837.978174:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724672 00000100:00100000:3.0:1788625837.978248:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:3.0:1788625837.978261:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:10597:x1875509823724672:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788625837.978379:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.978402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.978439:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625837.978809:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788625837.978821:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387975091760ns, next at 388975088873ns, rc = 0 00000004:00010000:3.0:1788625837.978953:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1b8407d reply state 00000000e649ec93 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625837.978964:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625837.979095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:10597:x1875509823724672:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 837us (1262us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788625837.979104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00010000:00010000:3.0:1788625837.987355:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987383:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987393:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987400:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625837.987407:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987417:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987440:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:3.0:1788625837.987443:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625837.987471:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.987478:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625837.995358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625837.996083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724800 00000100:00100000:3.0:1788625837.996100:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724800 00000100:00100000:3.0:1788625837.996189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1788625837.996203:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:10597:x1875509823724800:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625837.996238:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625837.996270:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd07 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.996359:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.996379:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625837.996405:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:3.0:1788625837.996410:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625837.996415:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7200, rc 0) 00000100:00100000:3.0:1788625837.996503:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:10597:x1875509823724800:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 302us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625837.996511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:0.0:1788625838.016540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.016679:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823724928 00000100:00100000:2.0:1788625838.016695:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823724928 00000100:00100000:2.0:1788625838.016849:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1788625838.016872:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823724928:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788625838.017301:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823724928:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 439us (774us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788625838.017312:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00080000:3.0:1788625838.018126:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625838.021454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.026466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823725184 00000100:00100000:2.0:1788625838.026485:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823725184 00000100:00100000:2.0:1788625838.026593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625838.026605:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:10597:x1875509823725184:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625838.026983:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:10597:x1875509823725184:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 378us (5543us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788625838.027010:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:0.0:1788625838.032437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.033815:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823725440 00000100:00100000:2.0:1788625838.033834:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823725440 00000100:00100000:2.0:1788625838.033949:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:2.0:1788625838.033963:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:10597:x1875509823725440:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625838.034262:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:10597:x1875509823725440:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 300us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625838.034272:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1788625838.037811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.038199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823725568 00000100:00100000:3.0:1788625838.038228:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823725568 00000100:00100000:3.0:1788625838.038299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:3.0:1788625838.038312:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:10597:x1875509823725568:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625838.038341:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625838.038372:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd0e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038461:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038477:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038494:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625838.038537:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625838.038569:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038598:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd0e expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038622:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd0e expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.038632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:3.0:1788625838.038635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788625838.040317:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625838.043004:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:10597:x1875509823725568:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4672us (5188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.043054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:1.0:1788625838.057780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625838.059478:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823725696 00000100:00100000:0.0:1788625838.059498:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823725696 00000100:00100000:0.0:1788625838.059667:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625838.059694:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823725696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625838.059723:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625838.060028:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd15 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625838.060632:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c43ae, blocks: 0x1 00010000:00010000:0.0:1788625838.060685:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788625838.060692:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.060709:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.060774:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.060794:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dae00, rc 0) 00000100:00100000:0.0:1788625838.061246:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2365:x1875509823725696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1554us (3528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625838.061281:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625838.072101:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.072289:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823725952 00000100:00100000:2.0:1788625838.072302:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823725952 00000100:00100000:2.0:1788625838.072379:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1788625838.072392:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:10597:x1875509823725952:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625838.072551:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:10597:x1875509823725952:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 160us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625838.072559:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1788625838.086103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625838.086332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726080 00000100:00100000:0.0:1788625838.086346:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726080 00000100:00100000:0.0:1788625838.086426:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:0.0:1788625838.086438:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:10597:x1875509823726080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625838.086462:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625838.086487:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd1c expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.086532:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.086543:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.086549:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.086555:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.086603:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.086621:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.086639:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875509845759744:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625838.086857:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625838.090257:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875509845759744:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625838.090309:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.090337:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da000, rc 0) 00000100:00100000:3.0:1788625838.090416:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:10597:x1875509823726080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3979us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.090427:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1788625838.091199:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625838.091290:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726208 00000100:00100000:0.0:1788625838.091300:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726208 00010000:00010000:0.0:1788625838.091345:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.091388:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1788625838.091398:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357256450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:2366:x1875509823726208:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625838.091415:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625838.091447:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.091463:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.091492:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b39c18b/0x8aede7274cb13f6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd15 expref: 11 pid: 6697 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.091510:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.091515:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.091525:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.091535:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.091846:0:7642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.091866:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7642:1875509845759872:192.168.201.45@tcp:105: 00000100:00100000:0.0:1788625838.091961:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625838.098063:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7642:1875509845759872:192.168.201.45@tcp:105: 00010000:00010000:2.0:1788625838.098113:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625838.098202:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357256450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2366:x1875509823726208:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 6803us (7004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625838.098215:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:1.0:1788625838.108286:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.110419:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726336 00000100:00100000:2.0:1788625838.110441:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726336 00002000:00100000:2.0:1788625838.110528:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b437f960e00 x1875509823726336/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:649/0 lens 504/0 e 0 to 0 dl 1788625849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625838.110567:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f960e00 with x1875509823726336 ext(0->12) 00002000:00010000:2.0:1788625838.110575:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f960e00 00000100:00100000:2.0:1788625838.110629:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1788625838.110641:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2366:x1875509823726336:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788625838.111348:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:2366:x1875509823726336:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 705us (3075us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788625838.111359:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:2.0:1788625838.111368:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b437f960e00 x1875509823726336/t4294967308(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:649/0 lens 504/448 e 0 to 0 dl 1788625849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625838.111377:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f960e00 with x1875509823726336 ext(0->12) 00002000:00010000:2.0:1788625838.111382:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f960e00 00000100:00100000:1.0:1788625838.121892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.122295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726464 00000100:00100000:2.0:1788625838.122308:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726464 00000100:00100000:2.0:1788625838.122394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:2.0:1788625838.122407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:10597:x1875509823726464:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788625838.236829:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000020:00080000:0.0:1788625838.236884:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b4350190d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788625838.236891:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4347c97b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b4350190480 00000020:00080000:0.0:1788625838.236895:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4347c97700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4348fe7400 00000001:00080000:0.0:1788625838.236922:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788625838.236946:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788625838.236969:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788625838.236990:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788625838.237009:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b43502d6540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788625838.237013:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4351779a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b43502d6000 00000020:00080000:0.0:1788625838.237016:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4351779b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4379965400 00000100:00100000:0.0:1788625838.237275:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845760000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788625838.237371:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625838.237459:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625838.237466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845760128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788625838.237490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625838.237530:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845760256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788625838.237554:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625838.237617:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845760000 00000100:00100000:0.0:1788625838.237627:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845760000 00000100:00100000:1.0:1788625838.237898:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10597:x1875509823726464:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 115489us (116018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625838.237910:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:0.0:1788625838.242073:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845760128 00000100:00100000:0.0:1788625838.242097:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845760128 00000100:00100000:0.0:1788625838.242129:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845760256 00000100:00100000:0.0:1788625838.242132:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845760256 00000100:00100000:0.0:1788625838.242153:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625838.242166:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845760000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788625838.242212:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788625838.242260:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c43ac, atime: 0x6a9c43ac, ctime: 0x6a9c43ac, blocks: 0x1 00010000:00010000:0.0:1788625838.242270:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.242292:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788625838.242297:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.242305:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.242327:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.242340:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.242350:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.242384:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625838.243194:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845760000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1027us (5819us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788625838.243205:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625838.243233:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625838.243242:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845760128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788625838.243261:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788625838.243282:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243301:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243310:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788625838.243313:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625838.243317:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243357:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243373:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 11 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.243390:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845760384:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625838.243486:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625838.243518:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625838.243534:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875509845760256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788625838.243666:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788625838.243671:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788625838 00002000:00010000:0.0:1788625838.243674:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788625838.243676:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788625838 -> 1788625838 00002000:00010000:0.0:1788625838.243678:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788625838.243716:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3310:x1875509845760256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (6160us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788625838.243723:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788625838.243778:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625838.243786:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243795:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dae00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625838.243801:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.243813:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788625838.244300:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788625838.244474:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:3.0:1788625838.244851:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625838.244858:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625838.245025:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.245321:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726592 00000100:00100000:2.0:1788625838.245331:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726592 00000100:00100000:2.0:1788625838.245389:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:2.0:1788625838.245399:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:2365:x1875509823726592:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788625838.254574:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.254604:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b39c18b/0x8aede7274cb13f7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.254654:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625838.254677:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625838.254680:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625838.254796:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b4379719c00/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788625838.254811:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845760256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788625838.254872:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b437b4a2d80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788625838.254877:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845760000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788625838.273638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.279160:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726720 00000100:00100000:3.0:1788625838.279183:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726720 00010000:00010000:3.0:1788625838.279260:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 13 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.279308:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:3.0:1788625838.279319:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823726720:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625838.279338:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625838.279345:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 13 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.279361:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 13 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.279418:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625838.279425:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625838.279432:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.279444:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.279470:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625838.279553:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823726720:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 235us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.279561:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00010000:00010000:0.0:1788625838.284380:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb13d3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc7b expref: 12 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.284411:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845760384:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625838.284446:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.284459:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.284467:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.284481:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.284490:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.284522:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625838.285237:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1875509845760128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41992us (47741us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788625838.285250:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788625838.285327:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b437b4a1880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788625838.285335:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845760128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788625838.285672:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625838.285684:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.285710:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625838.285716:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.285754:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.285779:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.285787:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2087e70/0x8aede7274cb13f84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.285809:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625838.285811:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625838.285813:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625838.325819:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788625838.340296:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788625838.340336:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788625838.340354:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788625838.340570:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823726592:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 95164us (95540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625838.340605:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1788625838.361713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.361942:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823726976 00000100:00100000:2.0:1788625838.361956:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823726976 00000100:00100000:2.0:1788625838.362039:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1788625838.362052:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10597:x1875509823726976:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625838.362129:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625838.362166:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb13f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd0e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.362192:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625838.362199:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625838.362243:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.362260:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.362272:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625838.362621:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ec9e9e4 reply state 00000000febacef8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.362632:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625838.362902:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:10597:x1875509823726976:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 852us (1204us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788625838.362910:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:1.0:1788625838.366383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:2.0:1788625838.366590:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366628:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366638:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366646:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625838.366653:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366662:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366686:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625838.366690:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625838.366697:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.366707:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13f8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.366981:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823727104 00000100:00100000:3.0:1788625838.366995:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823727104 00000100:00100000:3.0:1788625838.367064:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1788625838.367076:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823727104:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788625838.367377:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788625838.367381:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788625838 -> 1788625837 00002000:00010000:3.0:1788625838.367384:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788625836 00002000:00010000:3.0:1788625838.367386:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788625838 -> 1788625837 00002000:00010000:3.0:1788625838.367388:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788625838.367481:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823727104:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 406us (1113us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788625838.367491:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1788625838.384186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.384288:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823727360 00000100:00100000:3.0:1788625838.384319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823727360 00000100:00100000:3.0:1788625838.384398:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:3.0:1788625838.384410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:10597:x1875509823727360:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788625838.384508:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.384530:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.384541:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.384582:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.384598:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 15 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.384615:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845760512:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625838.384793:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351a039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625838.395127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625838.395240:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823727488 00000100:00100000:1.0:1788625838.395253:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823727488 00010000:00010000:1.0:1788625838.395308:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 16 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625838.395383:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:1.0:1788625838.395397:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:2365:x1875509823727488:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625838.395417:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625838.395425:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 16 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.395441:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 16 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.395469:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625838.395475:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.395486:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.395496:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.395520:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625838.395595:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:2365:x1875509823727488:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 201us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625838.395604:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00010000:00010000:3.0:1788625838.396079:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd00 expref: 15 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.396099:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845760512:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625838.396130:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396140:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396157:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396193:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396201:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396208:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396215:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625838.396220:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396228:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396240:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:3.0:1788625838.396243:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788625838.396249:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.396256:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13f92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.396324:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10597:x1875509823727360:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 11916us (12154us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788625838.396333:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:2.0:1788625838.408945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625838.409104:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823727616 00000100:00100000:0.0:1788625838.409118:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823727616 00000100:00100000:0.0:1788625838.409197:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1788625838.409210:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823727616:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788625838.409277:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.409305:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.409316:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625838.409321:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625838.409327:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.409373:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.409392:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 7 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.409410:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845760640:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625838.409552:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43454186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625838.413503:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845760640:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625838.413551:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.432968:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.433252:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823727744 00000100:00100000:3.0:1788625838.433268:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823727744 00010000:00010000:3.0:1788625838.433329:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 8 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.433385:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1788625838.433399:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2363:x1875509823727744:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625838.433419:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625838.433452:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 8 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.433471:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 8 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.433504:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e94a9b/0x8aede7274cb13f76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd1c expref: 8 pid: 6698 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.433530:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625838.433534:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625838.433542:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.433555:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.433601:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625838.433684:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823727744:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 288us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.433710:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00010000:00010000:0.0:1788625838.434187:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434200:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434233:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434243:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434251:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434259:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625838.434264:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434275:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434289:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.434296:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4817ec/0x8aede7274cb13f99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.434391:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823727616:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 25184us (25462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625838.434399:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1788625838.438881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625838.439045:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728000 00000100:00100000:0.0:1788625838.439059:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728000 00000100:00100000:0.0:1788625838.439126:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:0.0:1788625838.439137:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10597:x1875509823728000:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788625838.439245:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439269:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439284:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439563:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439576:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439586:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439646:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.439682:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 15 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625838.439701:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845760768:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625838.439842:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625838.444403:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845760768:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625838.444447:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.445067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625838.445328:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728128 00000100:00100000:1.0:1788625838.445340:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728128 00010000:00010000:1.0:1788625838.445392:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 16 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625838.445467:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1788625838.445479:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+16:2366:x1875509823728128:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625838.445500:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625838.445508:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 16 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445522:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 16 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445551:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb13f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd07 expref: 16 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445572:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:1.0:1788625838.445578:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445588:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445597:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625838.445638:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625838.446838:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:2366:x1875509823728128:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1342us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625838.446852:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00010000:00010000:0.0:1788625838.447047:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.447058:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625838.447312:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788625838.447495:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788625838.447545:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788625838.447702:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875509845760896:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788625838.447849:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625838.447894:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625838.452011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845760896 00000100:00100000:1.0:1788625838.452050:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845760896 00000100:00100000:1.0:1788625838.452138:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625838.452150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6721:x1875509845760896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788625838.452302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6721:x1875509845760896:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625838.452310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625838.452480:0:6721:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788625838.452489:0:6721:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788625838.452513:0:6721:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b4379719c00, transno 4294967309 00000100:00100000:2.0:1788625838.452530:0:6721:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b437b4a1880 x1875509845760128/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788625854 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625838.452546:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875509845760896:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788625838.453212:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788625838.453329:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875509845761024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788625838.453394:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625838.453423:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348b826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625838.455359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845761024 00000100:00100000:0.0:1788625838.455377:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845761024 00000100:00100000:0.0:1788625838.455438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625838.455449:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6721:x1875509845761024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788625838.455841:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6721:x1875509845761024:12345-0@lo:1000:mdt00_003.0 Request processed in 382us (2436us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788625838.455870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625838.459905:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875509845761024:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788625838.459985:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.459999:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460008:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460015:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625838.460020:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460042:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460064:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b435917bc00) 00010000:00010000:2.0:1788625838.460088:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625838.460094:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460101:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb13fa7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460147:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460153:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460160:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460165:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625838.460168:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460173:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460180:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625838.460183:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625838.460192:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 18 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460204:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 18 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460214:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 18 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.460274:0:6721:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 18 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.460292:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351618000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845761152:192.168.201.45@tcp:105: 00000100:00100000:2.0:1788625838.460391:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348b826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625838.464444:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.464558:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351618000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845761152:192.168.201.45@tcp:105: 00010000:00010000:2.0:1788625838.464595:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464608:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb13eea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464657:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464675:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464689:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464702:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464710:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464718:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464782:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625838.464788:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464797:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464812:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625838.464815:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625838.464819:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464824:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb13fae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464844:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464850:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464855:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464860:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625838.464863:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464869:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464887:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:2.0:1788625838.464889:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625838.464892:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.464898:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb13fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.465187:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10597:x1875509823728000:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 26050us (26320us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788625838.465200:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000020:00080000:2.0:1788625838.465208:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788625838.465541:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625838.465546:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625838.466049:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788625838.466061:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625838.466758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728256 00000100:00100000:3.0:1788625838.466774:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728256 00000100:00100000:3.0:1788625838.466856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1788625838.466868:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10596:x1875509823728256:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:3.0:1788625838.467437:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10596:x1875509823728256:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 166us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.467445:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1788625838.468699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.468869:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728512 00000100:00100000:2.0:1788625838.468882:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728512 00000100:00100000:2.0:1788625838.468939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1788625838.468950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436eac9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:10597:x1875509823728512:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788625838.470224:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788625838.470323:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788625838.470385:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470409:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470433:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470448:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470452:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625838.470524:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788625838.470648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436eac9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10597:x1875509823728512:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1697us (1953us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788625838.470656:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000020:00080000:2.0:1788625838.470661:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788625838.470937:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625838.470948:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.470956:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625838.470962:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.470972:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.470991:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b4356b43b00) 00010000:00010000:0.0:1788625838.470994:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788625838.471000:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.471007:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb13fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625838.471458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:0.0:1788625838.471536:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625838.471538:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625838.471541:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625838.473592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728768 00000100:00100000:3.0:1788625838.473615:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728768 00000100:00100000:3.0:1788625838.473889:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:3.0:1788625838.473903:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10596:x1875509823728768:12345-192.168.201.45@tcp:58:lfs.0 00000040:00080000:3.0:1788625838.474278:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788625838.474379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10596:x1875509823728768:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 478us (2923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.474387:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:1.0:1788625838.536045:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.536167:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823728896 00000100:00100000:3.0:1788625838.536183:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823728896 00000100:00100000:3.0:1788625838.536277:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:3.0:1788625838.536291:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:10599:x1875509823728896:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625838.536326:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625838.536355:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd23 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536443:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536479:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536495:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536513:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536521:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.536529:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.540060:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.540099:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.540110:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.540171:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.540193:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 21 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.540452:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845761280:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625838.540591:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351a039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625838.554419:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845761280:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625838.554483:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625838.555008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625838.555874:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823729152 00000100:00100000:2.0:1788625838.555890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823729152 00000100:00100000:2.0:1788625838.555981:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1788625838.555993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:5604:x1875509823729152:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788625838.556349:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:5604:x1875509823729152:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 356us (1342us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788625838.556358:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1788625838.559983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625838.560171:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823729280 00000100:00100000:3.0:1788625838.560185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823729280 00010000:00010000:3.0:1788625838.560256:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 23 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625838.560312:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1788625838.560324:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:2366:x1875509823729280:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625838.560344:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625838.560352:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 23 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560369:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 23 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560399:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb13edc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cce4 expref: 23 pid: 5841 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560430:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625838.560436:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560468:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560478:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625838.560528:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625838.560604:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2366:x1875509823729280:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 283us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625838.560612:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00010000:00010000:0.0:1788625838.560787:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560798:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625838.560878:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788625838.560884:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625838.560920:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560935:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560946:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560954:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560963:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560970:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625838.560977:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560987:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.560998:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:0.0:1788625838.561002:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625838.561006:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561013:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb13fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561041:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561048:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561055:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561061:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625838.561064:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561079:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b4352039b00) 00010000:00010000:0.0:1788625838.561082:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625838.561086:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561091:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb13fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561139:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd23 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561155:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd23 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625838.561175:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625838.561177:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625838.561180:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6400, rc 0) 00000100:00100000:0.0:1788625838.561218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10599:x1875509823728896:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 24930us (25192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625838.561225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00010000:00010000:1.0:1788625839.348396:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625839.475669:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625839.475680:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625839.475779:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788625839.475791:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625839.475983:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845761408:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625839.476108:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625839.484304:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625839.484345:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845761408:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625839.484445:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823729408 00000100:00100000:3.0:1788625839.484453:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823729408 00000100:00100000:3.0:1788625839.484539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:3.0:1788625839.484550:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10610:x1875509823729408:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788625839.484592:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788625839.484974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10610:x1875509823729408:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 423us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.484983:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00080000:1.0:1788625839.485128:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625839.497267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625839.497409:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823729664 00000100:00100000:0.0:1788625839.497420:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823729664 00000100:00100000:0.0:1788625839.497575:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:0.0:1788625839.497585:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:10610:x1875509823729664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625839.497619:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625839.497642:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13fd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd2a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.497768:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.497783:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.497795:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625839.497826:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788625839.497967:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13fd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd2a expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.497984:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd2a expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.497994:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625839.497996:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625839.498001:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db400, rc 0) 00000100:00100000:0.0:1788625839.498056:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10610:x1875509823729664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 472us (799us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788625839.498064:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1788625839.506891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625839.507283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625839.507363:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730048 00000100:00100000:0.0:1788625839.507374:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730048 00000100:00100000:3.0:1788625839.507555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823729920 00000100:00100000:3.0:1788625839.507560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823729920 00000100:00100000:3.0:1788625839.507599:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:3.0:1788625839.507625:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10610:x1875509823729920:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788625839.507699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.507717:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.507766:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508039:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508048:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508056:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508061:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625839.508066:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508074:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508095:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625839.508099:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788625839.508106:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.508112:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6600/0x8aede7274cb13fed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625839.508428:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:10610:x1875509823729920:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 803us (1547us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788625839.508437:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 132 00000040:00080000:3.0:1788625839.508568:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625839.508574:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788625839.509190:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1788625839.509205:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2365:x1875509823730048:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625839.509229:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625839.509246:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd2a expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.509260:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625839.509264:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625839.509288:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:2365:x1875509823730048:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 89us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625839.509295:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000040:00080000:3.0:1788625839.509546:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788625839.509555:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625839.512577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625839.512670:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730304 00000100:00100000:0.0:1788625839.512681:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730304 00000100:00100000:0.0:1788625839.512759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1788625839.512769:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:10610:x1875509823730304:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625839.513274:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10610:x1875509823730304:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 504us (706us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788625839.513283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000040:00080000:1.0:1788625839.583940:0:12119:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625839.583949:0:12119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625839.583998:0:12119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788625839.584004:0:12119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625839.604174:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845761536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625839.604256:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625839.605802:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845761536 00000100:00100000:0.0:1788625839.605825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845761536 00000100:00100000:0.0:1788625839.605888:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788625839.605898:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845761536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625839.605925:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788625839.612344:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845761536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6428us (8069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625839.612364:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625839.617541:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845761536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625839.766080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.766116:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.766143:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.766163:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.766207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.766238:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730432 00000100:00100000:3.0:1788625839.766248:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730432 00000100:00100000:3.0:1788625839.766327:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 296 00000100:00100000:3.0:1788625839.766338:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823730432:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625839.766404:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435dba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823730432:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.766411:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 296 00000100:00100000:3.0:1788625839.766448:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730688 00000100:00100000:3.0:1788625839.766452:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730688 00000100:00100000:3.0:1788625839.766475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730816 00000100:00100000:3.0:1788625839.766478:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730816 00000100:00100000:3.0:1788625839.766506:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1788625839.766513:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823730688:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625839.766540:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823730688:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.766547:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1788625839.766559:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1788625839.766573:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823730816:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625839.766595:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823730816:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.766601:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1788625839.766619:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730944 00000100:00100000:3.0:1788625839.766622:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730944 00000100:00100000:3.0:1788625839.766648:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823730560 00000100:00100000:3.0:1788625839.766650:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823730560 00000100:00100000:3.0:1788625839.766664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:3.0:1788625839.766671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823730944:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625839.766697:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2363:x1875509823730944:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.766703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:3.0:1788625839.766714:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:3.0:1788625839.766720:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2363:x1875509823730560:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625839.766779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:2363:x1875509823730560:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 59us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.766786:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00080000:1.0:1788625839.767004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625839.767010:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625839.819306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625839.819358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731200 00000100:00100000:0.0:1788625839.819370:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731200 00000100:00100000:0.0:1788625839.819432:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:0.0:1788625839.819445:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:10623:x1875509823731200:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625839.819465:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625839.819491:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd31 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.819588:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ffb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.819603:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.819631:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625839.819644:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788625839.819886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb13ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd31 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.819905:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd31 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.819914:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625839.819917:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788625839.819921:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798dae00, rc 0) 00000100:00100000:0.0:1788625839.820024:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10623:x1875509823731200:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 581us (727us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788625839.820031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:3.0:1788625839.831933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625839.832027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731328 00000100:00100000:0.0:1788625839.832038:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731328 00000100:00100000:0.0:1788625839.832102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:0.0:1788625839.832112:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10623:x1875509823731328:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1788625839.832184:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832201:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832214:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832254:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832262:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832269:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832276:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625839.832280:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832288:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832301:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:0.0:1788625839.832304:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625839.832308:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625839.832315:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625839.832381:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:10623:x1875509823731328:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 270us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625839.832388:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:2.0:1788625839.957306:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625839.957371:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731456 00000100:00100000:3.0:1788625839.957382:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731456 00000100:00100000:3.0:1788625839.957447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:3.0:1788625839.957457:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823731456:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1788625839.957475:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625839.957510:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90da4bd/0x8aede7274cb14010 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd38 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625839.957537:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c43ad, atime: 0x6a9c43ac, ctime: 0x6a9c43ad, blocks: 0xb 00010000:00010000:3.0:1788625839.957558:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788625839.957562:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625839.957571:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90da4bd/0x8aede7274cb14010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd38 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.957591:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b90da4bd/0x8aede7274cb14010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd38 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625839.957605:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6600, rc 0) 00000100:00100000:3.0:1788625839.957785:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823731456:12345-192.168.201.45@tcp:101:cat.0 Request processed in 328us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625839.957792:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:3.0:1788625839.961555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625839.961676:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731584 00000100:00100000:2.0:1788625839.961687:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731584 00002000:00100000:2.0:1788625839.961777:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b4347cd9f80 x1875509823731584/t0(0) o3->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:650/0 lens 488/0 e 0 to 0 dl 1788625850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625839.961788:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4347cd9f80 with x1875509823731584 ext(0->4095) 00002000:00010000:2.0:1788625839.961819:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b4347cd9f80 00000100:00100000:2.0:1788625839.961859:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1788625839.961869:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823731584:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:2.0:1788625839.962260:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823731584:12345-192.168.201.45@tcp:3:cat.0 Request processed in 391us (712us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788625839.962268:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:2.0:1788625839.962276:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b4347cd9f80 x1875509823731584/t0(0) o3->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:650/0 lens 488/4536 e 0 to 0 dl 1788625850 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625839.962284:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4347cd9f80 with x1875509823731584 ext(0->4095) 00002000:00010000:2.0:1788625839.962287:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b4347cd9f80 00010000:00010000:1.0:1788625840.371846:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788625840.782726:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788625840.782778:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788625841.140294:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845761792:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140368:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845762304:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140486:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788625841.140490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845761664:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140530:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845762176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140550:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140576:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140619:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625841.140623:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.140634:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.140660:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845761792 00000100:00100000:0.0:1788625841.140666:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845761792 00000100:00100000:0.0:1788625841.140698:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762176 00000100:00100000:0.0:1788625841.140700:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762176 00000100:00100000:0.0:1788625841.140714:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845761920 00000100:00100000:0.0:1788625841.140715:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845761920 00000100:00100000:0.0:1788625841.140725:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625841.140751:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.141649:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845761792:12345-0@lo:400:kworker.0 Request processed in 896us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625841.141658:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625841.141680:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788625841.141687:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845762176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.141722:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845762176:12345-0@lo:400:kworker.0 Request processed in 38us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625841.141769:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788625841.141793:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788625841.141800:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.142015:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845761920:12345-0@lo:400:kworker.0 Request processed in 216us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625841.142020:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788625841.142036:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762304 00000100:00100000:0.0:1788625841.142041:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762304 00000100:00100000:2.0:1788625841.142168:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.142919:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762048 00000100:00100000:0.0:1788625841.142926:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762048 00000100:00100000:3.0:1788625841.148672:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625841.148703:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845762304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625841.148863:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845762304:12345-0@lo:400:kworker.0 Request processed in 174us (8396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625841.148871:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625841.148900:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625841.148908:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875509845762048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625841.148953:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875509845762048:12345-0@lo:400:kworker.0 Request processed in 47us (8316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625841.148971:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625841.149030:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.153634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845761664 00000100:00100000:0.0:1788625841.153653:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845761664 00000100:00100000:0.0:1788625841.153713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788625841.153724:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.154205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845761664:12345-0@lo:400:kworker.0 Request processed in 481us (13691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625841.154214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1788625841.154283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625841.154289:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625841.154293:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625841.154325:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845761664:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.154344:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845762176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.154356:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845761792:0@lo:400:kworker.0 00000100:00100000:0.0:1788625841.154368:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788625841.154374:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788625841.154417:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b437b4a2d80, transno 4294967304 00000100:00100000:0.0:1788625841.154441:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845762304:0@lo:400:kworker.0 00010000:00010000:0.0:1788625841.399950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625841.653616:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625841.653637:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845762432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625841.653703:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625841.653798:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762432 00000100:00100000:0.0:1788625841.653805:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762432 00000100:00100000:0.0:1788625841.653848:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625841.653855:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845762432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625841.653888:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625841.653927:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845762432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625841.653934:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625841.653978:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845762432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625842.418940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788625843.289909:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788625843.289951:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b42410a0240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788625843.289957:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b438052e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b42410a00c0 00000020:00080000:1.0:1788625843.289961:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b438052e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4356bbe000 00000020:00080000:1.0:1788625843.289972:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788625843.289990:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788625843.290289:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788625843.445198:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625843.635041:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625843.635051:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625843.635107:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788625843.635114:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788625843.779947:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788625843.779969:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788625844.466871:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625844.724249:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625844.724274:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845762560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625844.724513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625844.724621:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762560 00000100:00100000:0.0:1788625844.724630:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762560 00000100:00100000:0.0:1788625844.724691:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788625844.724702:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845762560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625844.724783:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625844.724835:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845762560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625844.724842:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788625844.725072:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788625844.725079:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b437b4a1880, transno 4294967310 00000004:00080000:0.0:1788625844.725098:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788625844.725128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4351619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845762560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625844.726185:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625844.888219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625844.888296:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625844.888377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625844.888409:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625844.888435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625844.888462:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732224 00000100:00100000:0.0:1788625844.888471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732224 00000100:00100000:0.0:1788625844.888523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731840 00000100:00100000:0.0:1788625844.888537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731840 00000100:00100000:0.0:1788625844.888562:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:0.0:1788625844.888573:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823732224:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625844.888646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823732224:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625844.888654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:0.0:1788625844.888681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:0.0:1788625844.888689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2364:x1875509823731840:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625844.888751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2364:x1875509823731840:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625844.888759:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:0.0:1788625844.888780:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731968 00000100:00100000:0.0:1788625844.888783:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731968 00000100:00100000:0.0:1788625844.888807:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732096 00000100:00100000:0.0:1788625844.888809:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732096 00000100:00100000:0.0:1788625844.888826:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1788625844.888831:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823731968:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625844.888874:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2364:x1875509823731968:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625844.888880:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1788625844.888890:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:0.0:1788625844.888895:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823732096:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625844.888912:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823732096:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 17us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625844.888917:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00080000:0.0:1788625844.888929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625844.888932:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625844.888934:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625844.889323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823731712 00000100:00100000:3.0:1788625844.889329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823731712 00000100:00100000:3.0:1788625844.889404:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 298 00000100:00100000:3.0:1788625844.889413:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823731712:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625844.889441:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823731712:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625844.889447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 298 00000100:00100000:1.0:1788625845.029909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625845.030065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732352 00000100:00100000:0.0:1788625845.030076:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732352 00000100:00100000:0.0:1788625845.030150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:0.0:1788625845.030160:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10274:x1875509823732352:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788625845.030265:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10274:x1875509823732352:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625845.030273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:3.0:1788625845.037397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625845.037619:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732608 00000100:00100000:2.0:1788625845.037631:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732608 00000100:00100000:2.0:1788625845.037706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:2.0:1788625845.037759:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:10274:x1875509823732608:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625845.038098:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:10274:x1875509823732608:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 381us (709us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788625845.038106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:3.0:1788625845.238236:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625845.239157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732736 00000100:00100000:0.0:1788625845.239170:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732736 00000100:00100000:0.0:1788625845.239234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:0.0:1788625845.239244:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:11077:x1875509823732736:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:0.0:1788625845.239913:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625845.239972:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.240065:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.240080:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.240095:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625845.241463:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788625845.241473:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625845.242257:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.242436:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.242464:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625845.242474:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:0.0:1788625845.242477:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625845.242481:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798da600, rc 0) 00000100:00100000:0.0:1788625845.242570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:11077:x1875509823732736:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 3326us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625845.242578:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 136 00010000:00010000:3.0:1788625845.492063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625846.259347:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845763072:0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.259374:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845762816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625846.259634:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845762688:0@lo:400:kworker.0 00000100:00100000:3.0:1788625846.259784:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845762944:0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.265874:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625846.265966:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845763328:0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.266018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625846.266081:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763328 00000100:00100000:1.0:1788625846.266090:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763328 00000100:00100000:1.0:1788625846.266149:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625846.266160:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845763328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.266234:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845763328:12345-0@lo:400:kworker.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625846.266241:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788625846.266324:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625846.266369:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845763328:0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.266399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762816 00000100:00100000:1.0:1788625846.266417:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762816 00000100:00100000:1.0:1788625846.266447:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625846.266455:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845762816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.267395:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845762816:12345-0@lo:400:kworker.0 Request processed in 939us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625846.267403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625846.267624:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845762816:0@lo:400:kworker.0 00000100:00100000:0.0:1788625846.288950:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625846.289194:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763072 00000100:00100000:0.0:1788625846.289203:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763072 00000100:00100000:0.0:1788625846.289259:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625846.289270:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845763072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625846.289339:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845763072:12345-0@lo:400:kworker.0 Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625846.289347:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625846.289385:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845763072:0@lo:400:kworker.0 00000100:00080000:1.0:1788625846.289529:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625846.291354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625846.291437:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845763200:0@lo:400:kworker.0 00000100:00100000:2.0:1788625846.291483:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625846.292192:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762688 00000100:00100000:1.0:1788625846.292201:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762688 00000100:00100000:1.0:1788625846.292271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788625846.292281:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845762688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.292344:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845762688:12345-0@lo:400:kworker.0 Request processed in 65us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625846.292353:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788625846.292395:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763200 00000100:00100000:1.0:1788625846.292399:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763200 00000100:00100000:1.0:1788625846.292450:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788625846.292457:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845763200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625846.292490:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845763200:12345-0@lo:400:kworker.0 Request processed in 34us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625846.292496:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788625846.292512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625846.293283:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845762688:0@lo:400:kworker.0 00000100:00100000:2.0:1788625846.293303:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845763200:0@lo:400:kworker.0 00000100:00100000:3.0:1788625846.295646:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625846.295802:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845762944 00000100:00100000:1.0:1788625846.295815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845762944 00000100:00100000:1.0:1788625846.295907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788625846.295918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845762944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625846.296072:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625846.311968:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845762944:12345-0@lo:400:kworker.0 Request processed in 16041us (16317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625846.311985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788625846.312439:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845762944:0@lo:400:kworker.0 00010000:00010000:1.0:1788625846.518196:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625846.771104:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625846.771130:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845763456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625846.771209:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625846.771589:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763456 00000100:00100000:0.0:1788625846.771598:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763456 00000100:00100000:0.0:1788625846.771657:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788625846.771668:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845763456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625846.771715:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625846.771793:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845763456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625846.771802:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625846.771932:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845763456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625847.539156:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788625848.406197:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788625848.406253:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788625848.406265:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788625848.406431:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:2.0:1788625848.564031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625849.440306:0:12319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:30:47 (1788625847) 00010000:00010000:1.0:1788625849.590146:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625849.843292:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625849.843315:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435161b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625849.843388:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625849.843500:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763584 00000100:00100000:0.0:1788625849.843508:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763584 00000100:00100000:0.0:1788625849.843571:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788625849.843580:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845763584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625849.843654:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625849.843695:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845763584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625849.843701:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788625849.843790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625849.844182:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435161b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625850.019802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625850.019861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625850.019944:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625850.019975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625850.020009:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625850.020045:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733376 00000100:00100000:1.0:1788625850.020055:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733376 00000100:00100000:0.0:1788625850.020059:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733120 00000100:00100000:0.0:1788625850.020062:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733120 00000100:00100000:3.0:1788625850.020143:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732864 00000100:00100000:2.0:1788625850.020143:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823732992 00000100:00100000:2.0:1788625850.020147:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732992 00000100:00100000:3.0:1788625850.020164:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823732864 00000100:00100000:2.0:1788625850.020178:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:2.0:1788625850.020188:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2365:x1875509823733376:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625850.020189:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 300 00000100:00100000:3.0:1788625850.020194:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823732864:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625850.020273:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823732864:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 77us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625850.020280:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 300 00000100:00100000:1.0:1788625850.020673:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:1.0:1788625850.020684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823732992:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625850.023190:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733248 00000100:00100000:0.0:1788625850.023206:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733248 00000100:00100000:0.0:1788625850.023343:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1788625850.023355:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823733120:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625850.023498:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2365:x1875509823733376:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 3309us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625850.023509:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:2.0:1788625850.023586:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:2.0:1788625850.023594:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823733248:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625850.023622:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2365:x1875509823733248:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625850.023638:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00080000:2.0:1788625850.023680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625850.023684:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625850.023687:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625850.049179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823732992:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28484us (29188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625850.049195:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:0.0:1788625850.050944:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823733120:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27580us (31071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625850.050957:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00010000:00010000:0.0:1788625850.611028:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625851.178843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625851.179096:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733632 00000100:00100000:2.0:1788625851.179108:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733632 00000100:00100000:2.0:1788625851.179200:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:2.0:1788625851.179211:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11342:x1875509823733632:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625851.179233:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625851.179255:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd46 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179327:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179341:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179354:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179413:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179421:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179429:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179877:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb1403a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179890:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb1403a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.179897:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb1403a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625851.179918:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788625851.181213:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181229:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181237:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181242:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ae00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625851.181247:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181256:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181272:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039300) 00010000:00010000:2.0:1788625851.181275:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625851.181280:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181285:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1402c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181306:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181311:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181334:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181338:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625851.181341:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181347:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181355:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b4356b43500) 00010000:00010000:2.0:1788625851.181357:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625851.181360:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.181365:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14033 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.182445:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd46 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.182469:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb1403a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd46 expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.182478:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625851.182481:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625851.182485:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b600, rc 0) 00000100:00100000:2.0:1788625851.182560:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:11342:x1875509823733632:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3350us (3727us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788625851.182578:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:3.0:1788625851.196329:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625851.196440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733760 00000100:00100000:2.0:1788625851.196457:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733760 00000100:00100000:2.0:1788625851.196536:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:2.0:1788625851.196547:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:11342:x1875509823733760:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788625851.196694:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:11342:x1875509823733760:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 148us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625851.196701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:3.0:1788625851.198115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625851.199546:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823733888 00000100:00100000:2.0:1788625851.199563:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823733888 00000100:00100000:2.0:1788625851.199660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625851.199671:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:2363:x1875509823733888:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625851.199692:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625851.199716:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb1403a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd46 expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625851.199781:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625851.199787:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625851.199850:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2363:x1875509823733888:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 181us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625851.199857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1788625851.379971:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845763712:0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.380051:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845763968:0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.380063:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625851.380117:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845763840:0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.382650:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625851.382782:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625851.382795:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.382843:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625851.382935:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845764096 00000100:00100000:1.0:1788625851.382943:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845764096 00000100:00100000:1.0:1788625851.383020:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625851.383029:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845764096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.383082:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845764096:12345-0@lo:400:kworker.0 Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625851.383089:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788625851.383115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625851.383161:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.383213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763968 00000100:00100000:1.0:1788625851.383217:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763968 00000100:00100000:1.0:1788625851.383269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788625851.383278:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845763968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.383325:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845763968:12345-0@lo:400:kworker.0 Request processed in 38us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625851.383332:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788625851.383352:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625851.383370:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845763968:0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.383407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763712 00000100:00100000:1.0:1788625851.383411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763712 00000100:00100000:1.0:1788625851.383440:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788625851.383447:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845763712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.383481:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845763712:12345-0@lo:400:kworker.0 Request processed in 35us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625851.383496:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788625851.392991:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845763712:0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.393034:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.393101:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625851.393173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845764224 00000100:00100000:3.0:1788625851.393180:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845764224 00000100:00100000:3.0:1788625851.393236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625851.393244:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845764224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.393298:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845764224:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625851.393305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625851.393339:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845764224:0@lo:400:kworker.0 00000100:00080000:1.0:1788625851.395051:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625851.397033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625851.397099:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788625851.397146:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625851.397284:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845763840 00000100:00100000:1.0:1788625851.397294:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845763840 00000100:00100000:1.0:1788625851.397362:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788625851.397372:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845763840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625851.397428:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845763840:12345-0@lo:400:kworker.0 Request processed in 59us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625851.397435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788625851.397588:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845763840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.397851:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845764352 00000100:00100000:3.0:1788625851.397856:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845764352 00000100:00100000:3.0:1788625851.397951:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625851.397960:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845764352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625851.398012:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845764352:12345-0@lo:400:kworker.0 Request processed in 54us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625851.398018:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625851.398104:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845764352:0@lo:400:kworker.0 00000100:00080000:1.0:1788625851.398166:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788625851.638780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625851.827505:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625851.827513:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625851.828034:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788625851.828049:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625851.898540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845764480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625851.898630:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625851.898826:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845764480 00000100:00100000:0.0:1788625851.898834:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845764480 00000100:00100000:0.0:1788625851.898889:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625851.898901:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845764480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625851.898941:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625851.898990:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845764480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625851.898997:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625851.899080:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845764480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625852.659098:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788625853.470060:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788625853.684158:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625853.713353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625853.714065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734016 00000100:00100000:2.0:1788625853.714076:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734016 00000100:00100000:2.0:1788625853.714156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:2.0:1788625853.714167:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11384:x1875509823734016:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625853.714189:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625853.714210:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd4d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714277:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714293:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714305:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714320:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714326:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714332:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714552:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714560:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714582:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714587:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625853.714592:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714599:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714611:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:2.0:1788625853.714615:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625853.714619:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714625:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb1404f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714635:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714641:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714647:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714652:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625853.714654:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714669:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714677:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b4356b43700) 00010000:00010000:2.0:1788625853.714679:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625853.714682:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714688:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714752:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14048 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd4d expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714762:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:2.0:1788625853.714765:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625853.714769:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd4d expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625853.714779:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b000, rc 0) 00000100:00100000:2.0:1788625853.714842:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11384:x1875509823734016:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 676us (1498us total) trans 0 rc 301/301 00000100:00100000:2.0:1788625853.714849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00080000:1.0:1788625853.717652:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625853.723142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625853.723227:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734272 00000100:00100000:1.0:1788625853.723238:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734272 00000100:00100000:1.0:1788625853.723299:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:1.0:1788625853.723309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11384:x1875509823734272:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:1.0:1788625853.723366:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625853.723393:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4371017200/0x8aede7274cb139c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb86 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.723410:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:1.0:1788625853.723416:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625853.723661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.723676:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.723685:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.723719:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.723946:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 5 pid: 5842 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625853.724019:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845764608:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625853.724386:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625853.728313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625853.729142:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845764608:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625853.729169:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625853.729921:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734400 00000100:00100000:0.0:1788625853.729953:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734400 00000100:00080000:1.0:1788625853.730055:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625853.730128:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 6 pid: 5842 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625853.730218:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1788625853.730230:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2365:x1875509823734400:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625853.730246:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625853.730253:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 6 pid: 5842 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730266:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 6 pid: 5842 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730290:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1401e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd3f expref: 6 pid: 5842 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730308:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:0.0:1788625853.730313:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730322:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730330:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.730361:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625853.730556:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823734400:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 327us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625853.730585:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00010000:00010000:1.0:1788625853.730598:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.730606:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.730630:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.730649:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.730657:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625853.731794:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788625853.731808:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731817:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731824:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731830:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625853.731834:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731841:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731854:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4356b43c00) 00010000:00010000:1.0:1788625853.731857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625853.731861:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.731867:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1405d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625853.731896:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000107457f7 reply state 0000000091b47940 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625853.731904:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625853.731995:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:11384:x1875509823734272:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 8686us (8862us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788625853.732004:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 140 00010000:00010000:1.0:1788625853.740613:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740635:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740643:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740650:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625853.740656:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740665:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740685:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b4348a9f000) 00010000:00010000:1.0:1788625853.740688:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625853.740693:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.740699:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14064 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625853.819872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625853.820010:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734528 00000100:00100000:3.0:1788625853.820021:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734528 00000100:00100000:0.0:1788625853.820111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:0.0:1788625853.820127:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4351619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11392:x1875509823734528:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:0.0:1788625853.820157:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625853.820186:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1406b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd54 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820257:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820273:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625853.820322:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788625853.820326:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625853.820347:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820382:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb1406b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd54 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820515:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd54 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.820528:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:0.0:1788625853.820549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625853.820553:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43798db400, rc 0) 00000100:00100000:0.0:1788625853.820631:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4351619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:11392:x1875509823734528:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 509us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625853.820638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000040:00080000:2.0:1788625853.874995:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625853.875005:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625853.875259:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788625853.875282:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625853.922837:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625853.925220:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734656 00000100:00100000:0.0:1788625853.925236:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734656 00000100:00100000:0.0:1788625853.925389:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1788625853.925401:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:11398:x1875509823734656:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625853.925423:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625853.925445:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd5b expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925514:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925528:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925539:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925557:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925761:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925768:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925906:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925915:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.925921:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625853.925951:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788625853.925954:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625853.925994:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.926007:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930199:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930210:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930217:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625853.930222:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930232:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930251:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:0.0:1788625853.930275:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625853.930282:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930289:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da000/0x8aede7274cb14080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930310:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930315:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930321:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930326:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbe00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625853.930328:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930334:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930342:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b435917b600) 00010000:00010000:0.0:1788625853.930345:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625853.930347:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930353:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dbe00/0x8aede7274cb14087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930415:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da600/0x8aede7274cb14079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd5b expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930442:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd5b expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.930449:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625853.930451:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788625853.930453:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743000, rc 0) 00000100:00100000:0.0:1788625853.930530:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:11398:x1875509823734656:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5130us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625853.930539:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:3.0:1788625853.939533:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625853.939628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823734912 00000100:00100000:0.0:1788625853.939638:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823734912 00000100:00100000:0.0:1788625853.939707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:0.0:1788625853.939717:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+15:11398:x1875509823734912:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625853.939769:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625853.939789:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14095 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.939926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.939942:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.939955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940047:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940055:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625853.940633:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788625853.940854:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940865:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940872:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940905:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940912:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940917:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940923:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625853.940928:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940935:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940958:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625853.940960:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625853.940965:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.940971:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1409c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625853.940984:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bfb1d82 reply state 000000006923eb41 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625853.940992:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625853.941021:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14095 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.941033:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.941040:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:0.0:1788625853.941042:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625853.941044:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742400, rc 0) 00000100:00100000:0.0:1788625853.941108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11398:x1875509823734912:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1393us (1585us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788625853.941117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 143 00010000:00010000:0.0:1788625853.945359:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625853.947013:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625853.947060:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823735040 00000100:00100000:3.0:1788625853.947070:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823735040 00000100:00100000:3.0:1788625853.947135:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1788625853.947146:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2366:x1875509823735040:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625853.947164:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625853.947187:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd69 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625853.947218:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788625853.947238:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1788625853.947242:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625853.947252:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.947271:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.947285:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7400, rc 0) 00010000:00010000:0.0:1788625853.947464:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.947482:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.947488:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625853.947493:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.947502:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.947517:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917bf00) 00010000:00010000:0.0:1788625853.947520:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625853.947524:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625853.947530:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788625853.948541:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625853.952716:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823735040:12345-192.168.201.45@tcp:101:bash.0 Request processed in 215us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625853.952755:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1788625853.954796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625853.955852:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823735168 00000100:00100000:3.0:1788625853.955864:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823735168 00000100:00100000:3.0:1788625853.955929:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1788625853.955940:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:11398:x1875509823735168:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625853.955959:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625853.955997:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd70 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.956033:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.956044:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625853.956049:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625853.956054:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.956093:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.956107:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 7 pid: 6698 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625853.956121:0:8805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1875509845764736:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625853.956238:0:8805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520ca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625853.983757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625853.985494:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823735296 00000100:00100000:1.0:1788625853.985516:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823735296 00010000:00010000:1.0:1788625853.985583:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 8 pid: 6698 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625853.985636:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:1.0:1788625853.985648:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823735296:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625853.985667:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625853.985695:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 8 pid: 6698 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.985710:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 8 pid: 6698 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.985762:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625853.985767:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625853.985778:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.985789:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625853.985828:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625853.985869:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845764864:192.168.201.45@tcp:105: 00000100:00100000:1.0:1788625853.985948:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43454180c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788625853.989545:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd7d1416/0x8aede7274cb140b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd69 expref: 8 pid: 6698 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625853.989589:0:8805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1875509845764736:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625853.989626:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625853.989643:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:1.0:1788625853.992162:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875509845764864:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625853.992191:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625853.992252:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823735296:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 6605us (8531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625853.992263:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1788625853.994658:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:11398:x1875509823735168:12345-192.168.201.45@tcp:101:bash.0 Request processed in 38707us (39857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625853.994673:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1788625854.008357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.008541:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823735552 00000100:00100000:0.0:1788625854.008553:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823735552 00000100:00100000:0.0:1788625854.008627:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:0.0:1788625854.008638:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:11398:x1875509823735552:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:0.0:1788625854.009178:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11398:x1875509823735552:12345-192.168.201.45@tcp:35:bash.0 Request processed in 539us (828us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788625854.009187:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1788625854.145851:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625854.145980:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823735808 00000100:00100000:1.0:1788625854.145989:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823735808 00000100:00100000:1.0:1788625854.146048:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:1.0:1788625854.146058:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11408:x1875509823735808:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625854.146082:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625854.146104:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb140c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd77 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625854.146789:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788625854.146916:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb140c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd77 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.146933:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:1.0:1788625854.146936:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625854.146943:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb140c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd77 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.146960:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4ce00, rc 0) 00000100:00100000:1.0:1788625854.147043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435db03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11408:x1875509823735808:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 985us (1202us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788625854.147050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:3.0:1788625854.153109:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.153207:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736064 00000100:00100000:0.0:1788625854.153218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736064 00000100:00100000:0.0:1788625854.153276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1788625854.153303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11408:x1875509823736064:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1788625854.153589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11408:x1875509823736064:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 287us (489us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788625854.153597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:3.0:1788625854.265421:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.266963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736192 00000100:00100000:0.0:1788625854.266979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736192 00000100:00100000:0.0:1788625854.267250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:0.0:1788625854.267262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11415:x1875509823736192:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625854.267304:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625854.267328:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267415:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267441:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267455:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625854.267490:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788625854.267503:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625854.267521:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd7e expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267628:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd7e expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.267636:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625854.267638:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625854.267642:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742200, rc 0) 00000100:00100000:0.0:1788625854.267714:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:11415:x1875509823736192:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 455us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625854.267721:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:2.0:1788625854.277836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.278233:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736448 00000100:00100000:0.0:1788625854.278244:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736448 00000100:00100000:0.0:1788625854.278373:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:0.0:1788625854.278384:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437971ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:11415:x1875509823736448:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625854.278405:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625854.278443:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd85 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.278587:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb140e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.278603:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb140e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.278615:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb140e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625854.278626:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788625854.278812:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb140e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd85 expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.278832:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb140e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd85 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.278841:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:0.0:1788625854.278843:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625854.278847:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743600, rc 0) 00000100:00100000:0.0:1788625854.279047:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437971ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11415:x1875509823736448:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 663us (1468us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788625854.279055:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:2.0:1788625854.282838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625854.287106:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625854.287132:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736832 00000100:00100000:3.0:1788625854.287142:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736832 00000100:00100000:3.0:1788625854.287219:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1788625854.287231:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:2364:x1875509823736832:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625854.287248:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625854.287275:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb140e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd85 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625854.287296:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:3.0:1788625854.287302:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625854.287366:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2364:x1875509823736832:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625854.287435:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736704 00000100:00100000:1.0:1788625854.287442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736704 00000100:00100000:1.0:1788625854.287477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:1.0:1788625854.287485:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11415:x1875509823736704:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625854.287503:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625854.287519:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb140f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd8c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.287638:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.287654:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.287666:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625854.287678:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788625854.288709:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb140f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd8c expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.288750:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd8c expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.288759:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:1.0:1788625854.288762:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788625854.288779:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c000, rc 0) 00000100:00100000:1.0:1788625854.288846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:11415:x1875509823736704:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1360us (6019us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788625854.288854:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:3.0:1788625854.288859:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1788625854.305321:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625854.310909:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823736960 00000100:00100000:1.0:1788625854.310926:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823736960 00000100:00100000:1.0:1788625854.311025:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1788625854.311037:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823736960:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:1.0:1788625854.311102:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.311124:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 6 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.311133:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788625854.311138:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625854.311142:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.311181:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 6 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.311194:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 6 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625854.311209:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875509845764992:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625854.311317:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43454180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625854.313791:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875509845764992:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625854.313820:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625854.320120:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625854.320442:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737088 00000100:00100000:3.0:1788625854.320452:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737088 00002000:00100000:3.0:1788625854.320504:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b4379719c00 x1875509823737088/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:665/0 lens 504/0 e 0 to 0 dl 1788625865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625854.320515:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4379719c00 with x1875509823737088 ext(0->12) 00010000:00010000:3.0:1788625854.320525:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 7 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625854.320566:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 7 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625854.320574:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b4379719c00 00000100:00100000:3.0:1788625854.320606:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1788625854.320617:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823737088:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1788625854.321188:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823737088:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 569us (1075us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788625854.321196:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:3.0:1788625854.321205:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b4379719c00 x1875509823737088/t4294967305(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:665/0 lens 504/448 e 0 to 0 dl 1788625865 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625854.321213:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b4379719c00 with x1875509823737088 ext(0->12) 00010000:00010000:3.0:1788625854.321218:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625854.321231:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625854.321249:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b4379719c00 00000100:00100000:2.0:1788625854.326475:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.326642:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737216 00000100:00100000:0.0:1788625854.326652:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737216 00010000:00010000:0.0:1788625854.326690:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625854.326767:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1788625854.326777:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2364:x1875509823737216:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625854.326802:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788625854.326824:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788625854.326827:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788625854 00002000:00010000:0.0:1788625854.326829:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788625854 00002000:00010000:0.0:1788625854.326831:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788625854 00010000:00010000:0.0:1788625854.326838:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.326876:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.326902:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066bb8d70/0x8aede7274cb140bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd70 expref: 9 pid: 8805 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.326920:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625854.326924:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625854.326930:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.326939:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.326966:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625854.327037:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2364:x1875509823737216:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 261us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625854.327045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00010000:00010000:2.0:1788625854.328052:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328067:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328099:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328108:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328116:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328141:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625854.328146:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328155:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328171:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.328178:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb1410c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625854.328255:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823736960:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 17219us (22942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625854.328264:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625854.342422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.342772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737472 00000100:00100000:0.0:1788625854.342796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737472 00000100:00100000:0.0:1788625854.342854:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1788625854.342865:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:11415:x1875509823737472:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:0.0:1788625854.342930:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd8c expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625854.343252:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788625854.343296:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788625854.343868:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788625854.343932:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.343949:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.343957:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.343993:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.344008:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 28 pid: 5842 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625854.344021:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875509845765120:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625854.344114:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43504af300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625854.348902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625854.349684:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737600 00000100:00100000:0.0:1788625854.349696:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737600 00000100:00100000:2.0:1788625854.349992:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4377f3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875509845765120:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625854.350037:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350329:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 29 pid: 5842 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625854.350475:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:0.0:1788625854.350488:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:2365:x1875509823737600:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625854.350528:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625854.350537:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 29 pid: 5842 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350563:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 29 pid: 5842 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350589:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb140aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd62 expref: 29 pid: 5842 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350605:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:0.0:1788625854.350610:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350621:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350629:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625854.350656:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625854.350719:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:2365:x1875509823737600:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 234us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625854.350762:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00010000:00010000:2.0:1788625854.350822:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.350829:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625854.350958:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788625854.351174:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788625854.351283:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845765248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788625854.351339:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625854.351383:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625854.351574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845765248 00000100:00100000:1.0:1788625854.351582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845765248 00000100:00100000:1.0:1788625854.351637:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625854.351645:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875509845765248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625854.351718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875509845765248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625854.351724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625854.351793:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845765248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788625854.352327:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788625854.352391:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845765376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625854.352429:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625854.352461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845765376 00000100:00100000:1.0:1788625854.352465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845765376 00000100:00100000:1.0:1788625854.352489:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625854.352497:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875509845765376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625854.352641:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875509845765376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (211us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788625854.352648:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625854.352666:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350498300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625854.352685:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845765376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788625854.352753:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788625854.352797:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352806:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352814:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352819:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625854.352823:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352831:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352845:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:1.0:1788625854.352848:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788625854.352852:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.352858:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14113 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788625854.353009:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788625854.353130:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788625854.353143:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404349413646ns, next at 405349411400ns, rc = 0 00000001:00080000:1.0:1788625854.353150:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788625854.353179:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bd00) 00010000:00010000:1.0:1788625854.353182:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788625854.353189:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb140fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd8c expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625854.353286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:11415:x1875509823737472:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 10422us (10875us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788625854.353294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000020:00080000:1.0:1788625854.353298:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788625854.354958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625854.357642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625854.357717:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737728 00000100:00100000:1.0:1788625854.357760:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737728 00000100:00100000:1.0:1788625854.357827:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:1.0:1788625854.357837:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:11415:x1875509823737728:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625854.357860:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625854.357883:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb1411a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd93 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.357946:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb1411a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd93 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.357961:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb1411a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd93 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.357980:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625854.357983:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625854.357987:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c400, rc 0) 00000100:00100000:1.0:1788625854.358053:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11415:x1875509823737728:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 217us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625854.358060:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:1.0:1788625854.362990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625854.363164:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823737984 00000100:00100000:2.0:1788625854.363174:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823737984 00000100:00100000:2.0:1788625854.363240:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1788625854.363251:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11415:x1875509823737984:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625854.363524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:11415:x1875509823737984:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 274us (544us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788625854.363532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:3.0:1788625854.542572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625854.542677:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823738240 00000100:00100000:2.0:1788625854.542690:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823738240 00000100:00100000:2.0:1788625854.542787:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:2.0:1788625854.542807:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+33:11425:x1875509823738240:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625854.542835:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625854.542856:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a800/0x8aede7274cb14121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cd9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625854.543134:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788625854.543271:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a800/0x8aede7274cb14121 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd9a expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.543312:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:2.0:1788625854.543316:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625854.543323:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a800/0x8aede7274cb14121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd9a expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.543344:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a800, rc 0) 00000100:00100000:2.0:1788625854.544051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11425:x1875509823738240:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1244us (1497us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788625854.544060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:0.0:1788625854.553712:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625854.553941:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823738368 00000100:00100000:1.0:1788625854.553969:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823738368 00000100:00100000:1.0:1788625854.554030:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:1.0:1788625854.554042:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11425:x1875509823738368:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:1.0:1788625854.554128:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554145:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554159:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554174:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554182:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554188:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554291:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554300:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554307:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625854.554352:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554379:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554386:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554393:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554399:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625854.554403:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554424:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554438:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:1.0:1788625854.554440:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625854.554445:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554452:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb1412f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554467:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554473:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554478:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554489:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625854.554493:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554499:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554507:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4348a9f700) 00010000:00010000:1.0:1788625854.554510:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625854.554513:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554519:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554533:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554540:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554545:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554560:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625854.554563:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554568:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554585:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625854.554587:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625854.554591:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.554601:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1413d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625854.554692:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11425:x1875509823738368:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 649us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625854.554699:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:0.0:1788625854.560894:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625854.561112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823738624 00000100:00100000:2.0:1788625854.561123:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823738624 00000100:00100000:2.0:1788625854.561191:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1788625854.561202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11425:x1875509823738624:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625854.561485:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:11425:x1875509823738624:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 284us (600us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788625854.561494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1788625854.678377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625854.678955:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823738880 00000100:00100000:2.0:1788625854.678966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823738880 00000100:00100000:2.0:1788625854.679035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:2.0:1788625854.679046:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:11428:x1875509823738880:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625854.679071:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625854.679094:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a800/0x8aede7274cb14144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679188:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679230:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679247:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679255:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679262:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679384:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679394:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679402:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625854.679411:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788625854.679511:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679519:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679526:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679537:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625854.679542:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679564:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679576:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625854.679580:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625854.679585:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679591:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb1414b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679607:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679614:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679620:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679626:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ac00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625854.679629:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679635:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679652:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4356b43700) 00010000:00010000:2.0:1788625854.679654:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625854.679657:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679663:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb14152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679714:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a800/0x8aede7274cb14144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679805:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625854.679813:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625854.679815:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625854.679818:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b200, rc 0) 00000100:00100000:2.0:1788625854.679877:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11428:x1875509823738880:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 832us (1518us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788625854.679884:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:0.0:1788625854.686205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625854.686465:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823739008 00000100:00100000:1.0:1788625854.686476:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823739008 00000100:00100000:1.0:1788625854.686532:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:1.0:1788625854.686541:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11428:x1875509823739008:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1788625854.686619:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686635:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686648:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686673:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686680:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686719:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686725:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625854.686757:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686766:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686779:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625854.686790:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625854.686795:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625854.686803:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625854.686875:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11428:x1875509823739008:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 335us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625854.686883:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:0.0:1788625854.689293:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625854.689503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823739264 00000100:00100000:2.0:1788625854.689512:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823739264 00000100:00100000:2.0:1788625854.689581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1788625854.689592:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11428:x1875509823739264:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625854.689857:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:11428:x1875509823739264:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 266us (573us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788625854.689865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00010000:00010000:3.0:1788625854.708171:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625854.963137:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845765504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625854.963213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625854.963756:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845765504 00000100:00100000:2.0:1788625854.963766:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845765504 00000100:00100000:2.0:1788625854.963850:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625854.963862:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845765504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625854.963902:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625854.964006:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845765504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625854.964013:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788625854.965379:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625854.970749:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845765504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625855.088117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625855.088213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823739520 00000100:00100000:1.0:1788625855.088240:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823739520 00000100:00100000:1.0:1788625855.088332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:1.0:1788625855.088344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:11459:x1875509823739520:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:1.0:1788625855.088369:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625855.088391:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1416e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cda8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.088512:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.088527:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.088553:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788625855.088615:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788625855.088816:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788625855.088968:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb1416e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda8 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.088988:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda8 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.088997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625855.089000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625855.089004:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d400, rc 0) 00000100:00100000:1.0:1788625855.089070:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11459:x1875509823739520:12345-192.168.201.45@tcp:101:cat.0 Request processed in 728us (963us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788625855.089645:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:0.0:1788625855.094093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625855.095091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625855.095211:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823739648 00000100:00100000:1.0:1788625855.095221:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823739648 00000100:00100000:1.0:1788625855.095301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625855.095312:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:2366:x1875509823739648:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625855.095342:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625855.095384:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda8 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.095403:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625855.095408:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625855.095471:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+39:2366:x1875509823739648:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 161us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625855.095480:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1788625855.096203:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823739904 00000100:00100000:2.0:1788625855.096211:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823739904 00000100:00100000:2.0:1788625855.096259:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1788625855.096268:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+39:11459:x1875509823739904:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:2.0:1788625855.096790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11459:x1875509823739904:12345-192.168.201.45@tcp:35:cat.0 Request processed in 522us (1701us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788625855.096798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1788625855.129714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.130182:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.130226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.130261:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625855.130308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740416 00000100:00100000:2.0:1788625855.130318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740416 00000100:00100000:2.0:1788625855.130400:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:2.0:1788625855.130410:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823740416:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625855.130494:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2366:x1875509823740416:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625855.130503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:3.0:1788625855.130812:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740032 00000100:00100000:3.0:1788625855.130816:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740032 00000100:00100000:3.0:1788625855.130854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 302 00000100:00100000:3.0:1788625855.130862:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823740032:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625855.130898:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823740032:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625855.130904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 302 00000100:00080000:3.0:1788625855.130942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625855.145756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740160 00000100:00100000:1.0:1788625855.145773:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740160 00000100:00100000:1.0:1788625855.145877:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1788625855.145889:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823740160:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625855.145972:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823740160:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 86us (16268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625855.145980:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:0.0:1788625855.146239:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740288 00000100:00100000:0.0:1788625855.146245:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740288 00000100:00100000:0.0:1788625855.146275:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:0.0:1788625855.146283:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823740288:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625855.146315:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823740288:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 34us (16055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625855.146322:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00080000:2.0:1788625855.146397:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625855.146401:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625855.204179:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.204281:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740672 00000100:00100000:0.0:1788625855.204291:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740672 00000100:00100000:0.0:1788625855.204360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:0.0:1788625855.204370:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11465:x1875509823740672:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:0.0:1788625855.204394:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625855.204397:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788625855.204424:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb140db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd7e expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204443:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625855.204449:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625855.204462:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb14183 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204590:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204604:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204628:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204664:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.204678:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 40 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625855.204691:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845765632:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625855.204861:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43504af240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625855.212696:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845765632:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625855.212767:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625855.216986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625855.217473:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823740800 00000100:00100000:3.0:1788625855.217483:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823740800 00010000:00010000:3.0:1788625855.217527:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 41 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625855.217606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1788625855.217617:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+41:2366:x1875509823740800:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625855.217633:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625855.217640:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 41 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217654:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 41 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217676:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cda1 expref: 41 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217694:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:3.0:1788625855.217699:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217708:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217716:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.217950:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625855.218003:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:2366:x1875509823740800:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 388us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625855.218012:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:1.0:1788625855.218528:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.218548:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625855.218568:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788625855.218752:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb14183 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.218771:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.218800:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625855.218803:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625855.218806:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743c00, rc 0) 00000100:00100000:1.0:1788625855.218847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11465:x1875509823740672:12345-192.168.201.45@tcp:101:dd.0 Request processed in 14480us (14679us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788625855.218854:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:1.0:1788625855.227240:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625855.227607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741056 00000100:00100000:3.0:1788625855.227632:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741056 00000100:00100000:3.0:1788625855.227701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:3.0:1788625855.227712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11465:x1875509823741056:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:3.0:1788625855.228025:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.228044:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.228057:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625855.228108:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788625855.228134:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b26b9a4 reply state 00000000cb328e33 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625855.228143:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625855.228237:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:11465:x1875509823741056:12345-192.168.201.45@tcp:36:dd.0 Request processed in 527us (1006us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788625855.228244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 155 00000020:00080000:3.0:1788625855.228249:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788625855.243500:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243519:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243528:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243534:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625855.243550:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243559:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243578:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625855.243581:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625855.243586:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625855.243592:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14198 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625855.651718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.654816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741184 00000100:00100000:0.0:1788625855.654832:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741184 00000100:00100000:0.0:1788625855.655259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:0.0:1788625855.655272:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+42:11479:x1875509823741184:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:0.0:1788625855.655298:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625855.655322:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb1419f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdb6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.658906:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.658924:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.658955:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.658988:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.658995:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659002:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659098:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659107:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659144:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.659161:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 43 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625855.659175:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845765760:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625855.659273:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43504af240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625855.677904:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845765760:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625855.677938:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625855.678884:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625855.679189:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741440 00000100:00100000:2.0:1788625855.679198:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741440 00000100:00100000:2.0:1788625855.679261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:2.0:1788625855.679280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+44:5604:x1875509823741440:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788625855.679648:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:5604:x1875509823741440:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 369us (767us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788625855.679656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1788625855.684048:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625855.684600:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741568 00000100:00100000:3.0:1788625855.684611:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741568 00010000:00010000:3.0:1788625855.684654:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 45 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625855.684698:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:3.0:1788625855.684708:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:2366:x1875509823741568:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625855.684722:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625855.684773:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 45 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684803:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 45 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684826:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb1418a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdaf expref: 45 pid: 5842 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684844:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:3.0:1788625855.684848:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684858:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684865:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625855.684899:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625855.684955:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+44:2366:x1875509823741568:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 248us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625855.684970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00010000:00010000:0.0:1788625855.685138:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685146:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625855.685193:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788625855.685197:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625855.685221:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685233:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685243:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685250:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685256:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685264:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625855.685267:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685275:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685284:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625855.685287:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625855.685298:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685303:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685315:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685321:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685326:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685341:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625855.685344:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685350:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685357:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917bf00) 00010000:00010000:0.0:1788625855.685359:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625855.685362:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685368:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685417:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb1419f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdb6 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685444:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdb6 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.685450:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625855.685453:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625855.685455:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742600, rc 0) 00000100:00100000:0.0:1788625855.685484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:11479:x1875509823741184:12345-192.168.201.45@tcp:101:stat.0 Request processed in 30216us (33778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625855.685491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 156 00010000:00010000:1.0:1788625855.731043:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625855.770099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625855.770228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741824 00000100:00100000:2.0:1788625855.770239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741824 00000100:00100000:2.0:1788625855.770304:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 157 00000100:00100000:2.0:1788625855.770315:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:11485:x1875509823741824:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:2.0:1788625855.770396:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625855.770424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb141b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdb6 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625855.770445:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625855.770450:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625855.770892:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625855.770906:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625855.770916:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625855.770964:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788625855.770987:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074145229 reply state 00000000a93e3f72 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625855.770996:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625855.771109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:11485:x1875509823741824:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 795us (1019us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788625855.771117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 157 00000020:00080000:2.0:1788625855.771122:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788625855.783857:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783876:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783884:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783890:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625855.783895:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783903:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783919:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625855.783922:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625855.783927:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.783948:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb141bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625855.977538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625855.977782:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823741952 00000100:00100000:0.0:1788625855.977794:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823741952 00000100:00100000:0.0:1788625855.977855:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:0.0:1788625855.977865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+44:11499:x1875509823741952:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:0.0:1788625855.977895:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625855.977920:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdbd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978009:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978023:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978035:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978047:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978054:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978061:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978144:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978168:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978175:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625855.978209:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788625855.978213:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625855.978228:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978239:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978248:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978254:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978261:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978266:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625855.978270:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978278:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978289:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625855.978296:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625855.978301:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978308:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb141c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978321:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978433:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978440:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978445:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625855.978448:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978454:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978462:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917bf00) 00010000:00010000:0.0:1788625855.978472:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625855.978476:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978482:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb141d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978515:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb141c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978643:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625855.978650:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625855.978652:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625855.978655:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742e00, rc 0) 00000100:00100000:0.0:1788625855.978715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:11499:x1875509823741952:12345-192.168.201.45@tcp:101:stat.0 Request processed in 851us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625855.978721:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:2.0:1788625856.095515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000001:00080000:0.0:1788625856.098544:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788625856.098563:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788625856.098818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823742208 00000100:00100000:3.0:1788625856.098827:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823742208 00000100:00100000:3.0:1788625856.098884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:3.0:1788625856.098893:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+45:11509:x1875509823742208:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625856.098913:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625856.098948:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb141de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdc4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625856.099351:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788625856.099468:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb141de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdc4 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.099483:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:2.0:1788625856.099486:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625856.099491:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb141de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdc4 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.099507:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7400, rc 0) 00000100:00100000:2.0:1788625856.099583:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+46:11509:x1875509823742208:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 690us (4082us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788625856.099590:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:0.0:1788625856.102114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.102192:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823742464 00000100:00100000:2.0:1788625856.102201:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823742464 00000100:00100000:2.0:1788625856.102258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1788625856.102269:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+46:11509:x1875509823742464:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625856.102494:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:11509:x1875509823742464:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 226us (389us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788625856.102502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1788625856.158200:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.158685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823742720 00000100:00100000:0.0:1788625856.158700:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823742720 00000100:00100000:2.0:1788625856.160284:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:2.0:1788625856.160305:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:11515:x1875509823742720:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625856.160347:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625856.160369:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb141ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.160471:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.160487:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.160496:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.160553:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.160566:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 48 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625856.160580:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845765888:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625856.160688:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625856.165470:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845765888:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625856.165500:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625856.166259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.166348:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823742848 00000100:00100000:0.0:1788625856.166355:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823742848 00010000:00010000:0.0:1788625856.166398:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625856.166437:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1788625856.166448:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+49:2365:x1875509823742848:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625856.166463:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625856.166470:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166484:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166569:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb141d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdbd expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166589:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625856.166594:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166603:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166611:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.166640:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625856.166694:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+48:2365:x1875509823742848:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 245us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.166701:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00010000:00010000:3.0:1788625856.166778:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.166796:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625856.166828:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788625856.168266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb141ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.168390:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.168402:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625856.168405:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625856.168410:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a400, rc 0) 00000100:00100000:2.0:1788625856.168550:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+48:11515:x1875509823742720:12345-192.168.201.45@tcp:101:bash.0 Request processed in 8252us (10365us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788625856.168559:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:0.0:1788625856.172855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.174259:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823743104 00000100:00100000:1.0:1788625856.174272:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823743104 00000100:00100000:1.0:1788625856.174345:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:1.0:1788625856.174356:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+48:11515:x1875509823743104:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:1.0:1788625856.174649:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.174667:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.174679:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625856.174872:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788625856.174902:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f8a4c50 reply state 000000000387971e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625856.174912:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625856.175256:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11515:x1875509823743104:12345-192.168.201.45@tcp:36:bash.0 Request processed in 900us (2410us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788625856.175265:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 161 00000020:00080000:1.0:1788625856.175287:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788625856.192371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625856.194357:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823743232 00000100:00100000:3.0:1788625856.194371:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823743232 00000100:00100000:3.0:1788625856.194451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:3.0:1788625856.194462:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11515:x1875509823743232:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625856.194486:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625856.194526:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194610:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194625:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194633:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194640:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194675:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194703:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.194718:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625856.195204:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4357275180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845766016:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625856.195342:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520ca180 going to sleep for 11 seconds 00010000:00010000:1.0:1788625856.201435:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201453:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201468:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201473:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.201477:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201483:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201499:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625856.201501:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.201508:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201515:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.201529:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625856.208613:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.208672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823743360 00000100:00100000:0.0:1788625856.208682:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823743360 00000100:00100000:3.0:1788625856.208698:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4357275180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845766016:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625856.208721:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625856.208796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1788625856.208806:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:2366:x1875509823743360:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625856.208822:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625856.208829:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.208853:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208859:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208881:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a400/0x8aede7274cb141f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdcb expref: 52 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208902:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625856.208907:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208914:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208920:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.208948:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625856.209001:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:2366:x1875509823743360:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.209009:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00010000:00010000:3.0:1788625856.209249:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.209257:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625856.209302:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788625856.209306:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625856.209326:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.209413:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdd2 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.209444:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdd2 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625856.209452:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:3.0:1788625856.209454:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625856.209457:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625856.209497:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:11515:x1875509823743232:12345-192.168.201.45@tcp:101:bash.0 Request processed in 15038us (17138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625856.209504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:1.0:1788625856.215957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.216162:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823743616 00000100:00100000:2.0:1788625856.216170:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823743616 00000100:00100000:2.0:1788625856.216243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1788625856.216251:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:11515:x1875509823743616:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1788625856.216503:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11515:x1875509823743616:12345-192.168.201.45@tcp:35:bash.0 Request processed in 252us (565us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788625856.216509:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1788625856.346819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.347107:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823743872 00000100:00100000:1.0:1788625856.347119:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823743872 00000100:00100000:1.0:1788625856.347186:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:1.0:1788625856.347214:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11525:x1875509823743872:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625856.347240:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625856.347262:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdd9 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625856.347353:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788625856.347490:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14216 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdd9 expref: 53 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.347628:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:1.0:1788625856.347632:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625856.347702:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdd9 expref: 53 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.347721:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c000, rc 0) 00000100:00100000:1.0:1788625856.347842:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11525:x1875509823743872:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 629us (1034us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788625856.347850:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:3.0:1788625856.356159:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.357789:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823744000 00000100:00100000:2.0:1788625856.357804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823744000 00000100:00100000:2.0:1788625856.357882:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:2.0:1788625856.357893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11525:x1875509823744000:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1788625856.357981:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.357999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358027:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358043:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358050:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358057:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358148:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358157:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358164:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625856.358211:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358224:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358230:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358237:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358254:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625856.358258:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358266:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358279:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625856.358282:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625856.358287:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb14224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358312:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358323:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358328:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625856.358331:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358336:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358354:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4356b43700) 00010000:00010000:2.0:1788625856.358356:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625856.358359:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358366:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1422b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358380:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358386:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358391:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358395:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ba00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625856.358397:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358402:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358408:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625856.358410:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625856.358413:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.358418:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625856.358513:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11525:x1875509823744000:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 621us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.358532:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:3.0:1788625856.360717:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.361836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823744256 00000100:00100000:1.0:1788625856.361851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823744256 00000100:00100000:1.0:1788625856.361926:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:1.0:1788625856.361937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11525:x1875509823744256:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625856.362200:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+53:11525:x1875509823744256:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 264us (1496us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788625856.362209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1788625856.434434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.434596:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823744512 00000100:00100000:1.0:1788625856.434624:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823744512 00000100:00100000:1.0:1788625856.434701:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:1.0:1788625856.434712:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+53:11528:x1875509823744512:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625856.434778:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625856.434801:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cde0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434879:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434894:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434906:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434921:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434929:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.434936:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435081:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1424e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435090:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1424e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435097:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1424e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625856.435113:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788625856.435211:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435220:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435227:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435233:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.435238:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435246:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435259:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:1.0:1788625856.435262:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.435267:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435274:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb14240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435289:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435296:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435313:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435318:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.435321:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435328:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435337:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4348a9f700) 00010000:00010000:1.0:1788625856.435339:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.435342:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435349:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb14247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435391:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde0 expref: 56 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435404:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1424e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde0 expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.435411:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625856.435413:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625856.435415:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4dc00, rc 0) 00000100:00100000:1.0:1788625856.435484:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11528:x1875509823744512:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 773us (1058us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788625856.435499:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:3.0:1788625856.440002:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.440247:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823744640 00000100:00100000:0.0:1788625856.440260:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823744640 00000100:00100000:0.0:1788625856.440351:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1788625856.440364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:2365:x1875509823744640:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625856.440386:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625856.440434:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1424e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde0 expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.440459:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:0.0:1788625856.440466:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625856.440551:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:2365:x1875509823744640:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 189us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.440560:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1788625856.444220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.444341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823744768 00000100:00100000:2.0:1788625856.444355:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823744768 00000100:00100000:2.0:1788625856.444428:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:2.0:1788625856.444439:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11528:x1875509823744768:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1788625856.444545:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444569:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444584:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444619:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444627:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444636:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444642:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ba00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625856.444647:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444655:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444685:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625856.444688:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625856.444694:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.444701:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb1425c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625856.445045:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11528:x1875509823744768:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 605us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.445054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:3.0:1788625856.448075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.449252:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823745024 00000100:00100000:1.0:1788625856.449268:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823745024 00000100:00100000:1.0:1788625856.449338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1788625856.449349:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11528:x1875509823745024:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625856.449613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11528:x1875509823745024:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 264us (1615us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788625856.449621:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1788625856.499085:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.499200:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625856.499275:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.499332:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766400 00000100:00100000:2.0:1788625856.499344:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766400 00000100:00100000:1.0:1788625856.499351:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625856.499427:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788625856.499434:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437b4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845766144:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.499444:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625856.499471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625856.499509:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.499544:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845766400:12345-0@lo:400:kworker.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.499554:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788625856.499563:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625856.499634:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845766272:0@lo:400:kworker.0 00000100:00080000:3.0:1788625856.501568:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625856.502613:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625856.504656:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766656 00000100:00100000:2.0:1788625856.504679:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766656 00000100:00080000:2.0:1788625856.504763:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625856.504834:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.504926:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788625856.504938:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845766656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.505075:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845766656:12345-0@lo:400:kworker.0 Request processed in 138us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.505085:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788625856.505154:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766144 00000100:00100000:2.0:1788625856.505159:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766144 00000100:00100000:1.0:1788625856.505192:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.505200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788625856.505213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845766144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.505275:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845766144:12345-0@lo:400:kworker.0 Request processed in 63us (5803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.505284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788625856.505338:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766528 00000100:00100000:2.0:1788625856.505343:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766528 00000100:00100000:2.0:1788625856.505394:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788625856.505402:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.505444:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845766528:12345-0@lo:400:kworker.0 Request processed in 44us (6095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.505450:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788625856.505469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625856.505654:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845766784:0@lo:400:kworker.0 00000100:00100000:0.0:1788625856.505722:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625856.505819:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766784 00000100:00100000:0.0:1788625856.505826:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766784 00000100:00100000:0.0:1788625856.505904:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625856.505917:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845766784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625856.506281:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625856.506320:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845766272 00000100:00100000:3.0:1788625856.506330:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845766272 00000100:00100000:3.0:1788625856.506398:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788625856.506409:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845766272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625856.506412:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845766528:0@lo:400:kworker.0 00000100:00100000:3.0:1788625856.506492:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845766272:12345-0@lo:400:kworker.0 Request processed in 83us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625856.506501:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788625856.506562:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437b4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845766144:0@lo:400:kworker.0 00000100:00100000:1.0:1788625856.506609:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845766272:0@lo:400:kworker.0 00000100:00100000:0.0:1788625856.506684:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845766784:12345-0@lo:400:kworker.0 Request processed in 770us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.506693:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788625856.506851:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788625856.506857:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788625856.506873:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845766784:0@lo:400:kworker.0 00000100:00100000:0.0:1788625856.617872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.618555:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823745280 00000100:00100000:2.0:1788625856.618567:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823745280 00000100:00100000:2.0:1788625856.619007:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:2.0:1788625856.619025:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11546:x1875509823745280:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1788625856.619062:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625856.619088:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cde7 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.619981:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1426a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.620002:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1426a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.620017:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1426a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625856.620031:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788625856.620181:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde7 expref: 58 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.621187:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1426a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde7 expref: 57 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.621749:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625856.621755:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788625856.621760:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b000, rc 0) 00000100:00100000:2.0:1788625856.622283:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11546:x1875509823745280:12345-192.168.201.45@tcp:101:cat.0 Request processed in 3260us (4415us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788625856.626171:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:3.0:1788625856.641450:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.642616:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823745408 00000100:00100000:2.0:1788625856.642628:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823745408 00000100:00100000:2.0:1788625856.642701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1788625856.642712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11547:x1875509823745408:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625856.642789:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625856.642842:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.642909:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.642923:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.642936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625856.642969:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788625856.642973:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625856.642991:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.643018:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ba00/0x8aede7274cb14278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdee expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.643257:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdee expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.643267:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625856.643270:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625856.643274:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a600, rc 0) 00000100:00100000:2.0:1788625856.643345:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11547:x1875509823745408:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 634us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625856.643353:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:0.0:1788625856.650920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.651059:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823745792 00000100:00100000:2.0:1788625856.651085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823745792 00000100:00100000:2.0:1788625856.651147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1788625856.651157:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11547:x1875509823745792:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1788625856.651481:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11547:x1875509823745792:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 324us (570us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788625856.651488:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1788625856.658686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.658848:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823745920 00000100:00100000:1.0:1788625856.658860:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823745920 00000100:00100000:1.0:1788625856.658950:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625856.658961:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11547:x1875509823745920:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:1.0:1788625856.658979:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788625856.659006:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1420f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdd2 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.659032:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1426a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cde7 expref: 58 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.659046:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb1411a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd93 expref: 57 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.659073:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625856.659085:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625856.659153:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:11547:x1875509823745920:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 193us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625856.659161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625856.662611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.662912:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746048 00000100:00100000:0.0:1788625856.662926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746048 00000100:00100000:0.0:1788625856.663285:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:0.0:1788625856.663300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:11547:x1875509823746048:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:0.0:1788625856.663484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.663524:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.663542:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625856.663835:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788625856.663937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:11547:x1875509823746048:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 641us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.663943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:2.0:1788625856.733260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625856.734647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746176 00000100:00100000:0.0:1788625856.734665:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746176 00000100:00100000:0.0:1788625856.734824:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:0.0:1788625856.734838:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:11549:x1875509823746176:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625856.734867:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625856.734899:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb1428d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdf5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.734987:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735018:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735033:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735052:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735081:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735088:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735215:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735225:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735233:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625856.735278:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788625856.735283:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625856.735306:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735345:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735352:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735359:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735377:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625856.735383:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735392:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735408:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625856.735411:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625856.735417:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735425:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb14294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735440:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735447:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735454:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735459:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625856.735462:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735469:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735491:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917b600) 00010000:00010000:0.0:1788625856.735494:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625856.735497:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735504:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb1429b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb1428d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735573:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625856.735582:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:0.0:1788625856.735585:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625856.735588:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743600, rc 0) 00000100:00100000:0.0:1788625856.735673:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11549:x1875509823746176:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 838us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625856.735681:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00010000:00010000:0.0:1788625856.757144:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625856.948096:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625856.948111:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625856.948159:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788625856.948167:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625856.948351:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845766912:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625856.948494:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625856.954080:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801eea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845766912:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625856.963202:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.963351:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746304 00000100:00100000:1.0:1788625856.963365:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746304 00000100:00100000:1.0:1788625856.963445:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:1.0:1788625856.963457:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11560:x1875509823746304:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788625856.963501:0:6721:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788625856.963660:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11560:x1875509823746304:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625856.963668:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:1.0:1788625856.973418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625856.973479:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746432 00000100:00100000:1.0:1788625856.973492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746432 00000100:00100000:1.0:1788625856.973593:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:1.0:1788625856.973607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11560:x1875509823746432:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788625856.973713:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973759:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973776:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973797:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973805:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973812:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973847:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973864:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625856.973912:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788625856.973923:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625856.973939:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973954:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973962:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973969:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973976:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.973981:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.973990:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974006:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:1.0:1788625856.974008:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.974014:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974021:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb142a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974035:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974041:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974058:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974063:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.974066:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974072:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974081:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625856.974083:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.974086:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974092:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb142b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974109:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974116:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974122:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974126:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625856.974129:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974145:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974154:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:1.0:1788625856.974156:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625856.974159:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625856.974165:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c400/0x8aede7274cb142b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625856.974261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11560:x1875509823746432:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 656us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625856.974270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:1.0:1788625856.982684:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625856.992879:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746688 00000100:00100000:2.0:1788625856.992904:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746688 00000100:00100000:2.0:1788625856.992998:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:2.0:1788625856.993013:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11560:x1875509823746688:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625856.993046:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625856.993076:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cdfc expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993213:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993231:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993258:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625856.993271:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788625856.993408:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993417:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993424:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993430:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625856.993436:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993444:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993459:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:2.0:1788625856.993462:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625856.993468:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993475:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993545:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142be lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdfc expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993569:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625856.993572:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625856.993576:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdfc expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625856.993588:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94ae00, rc 0) 00000100:00100000:2.0:1788625856.993678:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823746688:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 667us (11006us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788625856.993686:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:1.0:1788625857.009768:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.009875:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823746816 00000100:00100000:2.0:1788625857.009889:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823746816 00000100:00100000:2.0:1788625857.009979:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:2.0:1788625857.009994:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823746816:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625857.010044:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625857.010195:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823746816:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 205us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.010204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00080000:1.0:1788625857.010344:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788625857.011950:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407008217023ns, next at 408008213555ns, rc = 0 00000100:00100000:1.0:1788625857.011981:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625857.012007:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845767040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625857.012093:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625857.012166:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845767040 00000100:00100000:1.0:1788625857.012175:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845767040 00000100:00100000:1.0:1788625857.012236:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788625857.012246:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845767040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625857.012294:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625857.012346:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845767040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625857.012370:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788625857.012426:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845767040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625857.018231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.018414:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747072 00000100:00100000:3.0:1788625857.018429:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747072 00000100:00100000:3.0:1788625857.018532:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:3.0:1788625857.018544:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823747072:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625857.018573:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625857.018578:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625857.018616:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb1427f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdee expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.018648:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625857.018655:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625857.018673:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb142d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce03 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625857.019670:0:6721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788625857.020019:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb142da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.020038:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb142da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.020052:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb142da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.020134:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb142d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce03 expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.020156:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb142da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce03 expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.020166:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039b00) 00010000:00010000:3.0:1788625857.020185:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625857.020190:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625857.020279:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11560:x1875509823747072:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1737us (2064us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788625857.020289:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:1.0:1788625857.032032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.032141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747328 00000100:00100000:2.0:1788625857.032157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747328 00000100:00100000:2.0:1788625857.032239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:2.0:1788625857.032260:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11560:x1875509823747328:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625857.032386:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625857.032424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb142da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce03 expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032472:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039b00) 00010000:00010000:2.0:1788625857.032489:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625857.032533:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032552:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032563:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032581:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032588:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032595:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032689:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032697:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032704:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032710:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ae00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625857.032715:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032777:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625857.032790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625857.032794:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032801:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb142e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032820:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032826:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032832:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032837:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625857.032839:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032845:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032851:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x83ba132 (ffff9b4356b43700) 00010000:00010000:2.0:1788625857.032853:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625857.032855:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.032872:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb142ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x83ba132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.032981:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823747328:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 730us (968us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625857.032989:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:1.0:1788625857.038606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.038697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747456 00000100:00100000:3.0:1788625857.038712:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747456 00000100:00100000:3.0:1788625857.038818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:3.0:1788625857.038830:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11560:x1875509823747456:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625857.038859:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625857.038894:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb142f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce0a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.038942:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.038961:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.038975:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.039101:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb142f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.039126:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.039135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:3.0:1788625857.039147:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788625857.039152:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7800, rc 0) 00000100:00100000:3.0:1788625857.039225:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11560:x1875509823747456:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 396us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.039233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:3.0:1788625857.059186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.059450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747712 00000100:00100000:2.0:1788625857.059465:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747712 00000100:00100000:2.0:1788625857.059549:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:2.0:1788625857.059563:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11560:x1875509823747712:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625857.059708:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.059770:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.059785:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625857.060185:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788625857.060198:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407056468503ns, next at 408056464723ns, rc = 0 00000004:00010000:2.0:1788625857.060327:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e4bba33 reply state 00000000649480cc transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.060339:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625857.060487:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11560:x1875509823747712:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 925us (1315us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788625857.060496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00010000:00010000:0.0:1788625857.069618:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069643:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069676:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069683:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625857.069690:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069700:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069723:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:0.0:1788625857.069761:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788625857.069768:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.069776:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14304 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625857.074942:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625857.075046:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747840 00000100:00100000:0.0:1788625857.075060:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747840 00000100:00100000:0.0:1788625857.075132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:0.0:1788625857.075143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11560:x1875509823747840:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625857.075176:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625857.075205:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce11 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.075289:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.075318:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.075344:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:0.0:1788625857.075348:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625857.075352:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742000, rc 0) 00000100:00100000:0.0:1788625857.075437:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11560:x1875509823747840:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 295us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625857.075445:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:2.0:1788625857.078687:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.082922:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823747968 00000100:00100000:1.0:1788625857.082944:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823747968 00000100:00100000:1.0:1788625857.083063:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:1.0:1788625857.083078:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823747968:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788625857.083566:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823747968:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 490us (4893us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788625857.083575:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00080000:2.0:1788625857.083665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625857.090702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.092139:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823748224 00000100:00100000:1.0:1788625857.092162:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823748224 00000100:00100000:1.0:1788625857.092260:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1788625857.092274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11560:x1875509823748224:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788625857.092620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11560:x1875509823748224:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 347us (1935us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788625857.092629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1788625857.102856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.103164:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823748480 00000100:00100000:3.0:1788625857.103179:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823748480 00000100:00100000:3.0:1788625857.103493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:3.0:1788625857.103525:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11560:x1875509823748480:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625857.103681:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11560:x1875509823748480:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 177us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.103689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:2.0:1788625857.113072:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.113199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823748608 00000100:00100000:1.0:1788625857.113214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823748608 00000100:00100000:1.0:1788625857.113293:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1788625857.113304:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11560:x1875509823748608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625857.113369:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625857.113397:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113496:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113541:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625857.113585:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625857.113609:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113640:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb14312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce18 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113659:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce18 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.113670:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:1.0:1788625857.113673:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788625857.113678:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d400, rc 0) 00000100:00100000:1.0:1788625857.113780:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+63:11560:x1875509823748608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 477us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625857.113789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1788625857.119670:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.120046:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823748736 00000100:00100000:2.0:1788625857.120061:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823748736 00000100:00100000:2.0:1788625857.120159:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625857.120172:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823748736:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625857.120205:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625857.120344:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce1f expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625857.120382:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c43c1, blocks: 0x1 00010000:00010000:2.0:1788625857.120408:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1788625857.120414:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625857.120428:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.120455:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.120472:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b600, rc 0) 00000100:00100000:2.0:1788625857.120563:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2364:x1875509823748736:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 393us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.120571:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625857.130521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.130651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823748992 00000100:00100000:1.0:1788625857.130666:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823748992 00000100:00100000:1.0:1788625857.130775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:1.0:1788625857.130788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+63:11560:x1875509823748992:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788625857.130940:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+63:11560:x1875509823748992:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 154us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625857.130949:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:3.0:1788625857.142484:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.142579:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749120 00000100:00100000:2.0:1788625857.142609:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749120 00000100:00100000:2.0:1788625857.142689:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:2.0:1788625857.142701:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:11560:x1875509823749120:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625857.142850:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625857.151870:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.151939:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.151950:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625857.151955:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625857.151961:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.152018:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.152047:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.152070:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875509845767168:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625857.152250:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625857.160478:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875509845767168:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625857.160544:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.160575:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7400, rc 0) 00000100:00100000:3.0:1788625857.160658:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435161ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:11560:x1875509823749120:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 17958us (18190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.160669:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1788625857.160869:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.161053:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749248 00000100:00100000:3.0:1788625857.161062:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749248 00010000:00010000:3.0:1788625857.161102:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.162256:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1788625857.162275:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2366:x1875509823749248:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625857.162296:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625857.162449:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.162483:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.162523:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cd699f/0x8aede7274cb14320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce1f expref: 9 pid: 8805 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.162542:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625857.162547:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625857.162558:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.162568:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.162615:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.162631:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f961880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875509845767296:192.168.201.45@tcp:105: 00000100:00100000:3.0:1788625857.162758:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625857.172537:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f961880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875509845767296:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625857.172595:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625857.172670:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823749248:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 10399us (11800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625857.172683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1788625857.172869:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.173023:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749376 00000100:00100000:1.0:1788625857.173033:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749376 00002000:00100000:1.0:1788625857.173092:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b437f961880 x1875509823749376/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:668/0 lens 504/0 e 0 to 0 dl 1788625868 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625857.173105:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f961880 with x1875509823749376 ext(0->8) 00002000:00010000:1.0:1788625857.173111:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f961880 00000100:00100000:1.0:1788625857.173146:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1788625857.173157:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823749376:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788625857.174279:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2365:x1875509823749376:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 1113us (1401us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788625857.174294:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00002000:00100000:1.0:1788625857.174304:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b437f961880 x1875509823749376/t4294967314(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:668/0 lens 504/448 e 0 to 0 dl 1788625868 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625857.174322:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f961880 with x1875509823749376 ext(0->8) 00002000:00010000:1.0:1788625857.174328:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f961880 00000100:00100000:3.0:1788625857.178316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.178455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749504 00000100:00100000:1.0:1788625857.178466:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749504 00000100:00100000:1.0:1788625857.178537:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:1.0:1788625857.178547:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+63:11560:x1875509823749504:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788625857.275820:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967426 is committed 00000001:00080000:2.0:1788625857.275873:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788625857.275882:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788625857.275919:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788625857.275931:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b4345418b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788625857.275937:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4379de6a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b43454180c0 00000020:00080000:2.0:1788625857.275940:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4379de6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4348fe5400 00000004:00080000:2.0:1788625857.275965:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788625857.276091:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11560:x1875509823749504:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 97537us (97776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.276103:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:2.0:1788625857.276157:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625857.276179:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845767424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788625857.276442:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625857.276532:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845767424 00000100:00100000:2.0:1788625857.276541:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845767424 00000100:00100000:2.0:1788625857.276592:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625857.276603:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845767424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788625857.276817:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788625857.276821:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788625857 00002000:00010000:2.0:1788625857.276823:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788625857.276826:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788625857 -> 1788625857 00002000:00010000:2.0:1788625857.276828:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788625857.277018:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845767552:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788625857.277466:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788625857.277684:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788625857.283296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625857.283351:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845767424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6747us (6905us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788625857.283369:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625857.284746:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845767552 00000100:00100000:2.0:1788625857.284763:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845767552 00000100:00100000:2.0:1788625857.284822:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625857.284834:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845767552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788625857.284879:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788625857.284925:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c43be, atime: 0x6a9c43be, ctime: 0x6a9c43be, blocks: 0xb 00010000:00010000:2.0:1788625857.284935:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.284955:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1788625857.284961:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625857.284968:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.284989:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285000:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285009:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285031:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788625857.285883:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4358382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845767552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1047us (2595us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788625857.285894:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788625857.285941:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625857.285949:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285961:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94bc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625857.285966:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285977:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.285997:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.286005:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082cbcd5e/0x8aede7274cb1432e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.286028:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625857.286030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625857.286032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788625857.286081:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b435166e300/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788625857.286090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845767424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788625857.286800:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.288395:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749632 00000100:00100000:2.0:1788625857.288412:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749632 00000100:00100000:2.0:1788625857.288476:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1788625857.288488:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2366:x1875509823749632:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788625857.293095:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b43656b3480/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788625857.294137:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845767552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788625857.401816:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2366:x1875509823749632:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 113314us (115004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.401841:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000001:00080000:1.0:1788625857.402313:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1788625857.402343:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788625857.410710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.411886:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823749888 00000100:00100000:1.0:1788625857.411903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823749888 00000100:00100000:1.0:1788625857.411984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:1.0:1788625857.411997:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11560:x1875509823749888:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625857.412071:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625857.412110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce18 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.412131:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:1.0:1788625857.412138:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625857.412182:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.412200:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.412211:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625857.412564:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d58400 reply state 00000000a589127d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625857.412576:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625857.412704:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11560:x1875509823749888:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 708us (2008us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788625857.412712:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 184 00010000:00010000:1.0:1788625857.423496:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423530:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423539:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423546:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625857.423553:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423561:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423584:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:1.0:1788625857.423588:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625857.423594:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.423600:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14335 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.425130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.425517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750016 00000100:00100000:2.0:1788625857.425533:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750016 00000100:00100000:2.0:1788625857.425606:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1788625857.425620:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823750016:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788625857.426018:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788625857.426023:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788625857 -> 1788625856 00002000:00010000:2.0:1788625857.426026:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788625854 00002000:00010000:2.0:1788625857.426028:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788625857 -> 1788625856 00002000:00010000:2.0:1788625857.426030:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788625857.426117:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823750016:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 498us (1000us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788625857.426126:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1788625857.429717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625857.429864:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750272 00000100:00100000:0.0:1788625857.429879:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750272 00000100:00100000:0.0:1788625857.429952:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:0.0:1788625857.429965:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:11560:x1875509823750272:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788625857.430053:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.430074:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.430085:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.430131:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.430168:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 18 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625857.430187:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845767680:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625857.430330:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625857.434098:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.434234:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875509845767680:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625857.434275:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.434464:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750400 00000100:00100000:2.0:1788625857.434473:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750400 00010000:00010000:2.0:1788625857.434534:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.434578:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1788625857.434589:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357257850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2365:x1875509823750400:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625857.434609:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625857.434618:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434632:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434677:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb142fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce0a expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434695:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:2.0:1788625857.434701:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434714:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434725:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.434787:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625857.434849:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357257850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:2365:x1875509823750400:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 261us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.434857:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00010000:00010000:3.0:1788625857.435404:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435417:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435454:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435462:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435469:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435475:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625857.435480:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435509:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435523:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:3.0:1788625857.435526:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788625857.435531:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.435537:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb1433c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.435603:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:11560:x1875509823750272:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 5639us (5898us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788625857.435613:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:0.0:1788625857.439973:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.440128:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750528 00000100:00100000:2.0:1788625857.440143:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750528 00000100:00100000:2.0:1788625857.440321:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1788625857.440334:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823750528:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788625857.440394:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.440418:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.440443:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625857.440448:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625857.440453:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.440511:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.440529:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.440546:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b435166f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875509845767808:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625857.440655:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348b826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625857.445535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.446213:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750656 00000100:00100000:3.0:1788625857.446228:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750656 00010000:00010000:3.0:1788625857.446284:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 9 pid: 6697 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.446352:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:3.0:1788625857.446365:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823750656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625857.446382:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625857.446411:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 9 pid: 6697 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.446429:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 9 pid: 6697 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.446472:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625857.446477:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625857.446486:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.446496:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.446533:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625857.446606:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823750656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 243us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.446615:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00010000:00010000:0.0:1788625857.448145:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce26 expref: 8 pid: 6697 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625857.448171:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b435166f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875509845767808:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625857.448276:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448291:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448362:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448405:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448415:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448445:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448452:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625857.448458:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448468:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448489:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.448496:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37c3217/0x8aede7274cb14343 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625857.448666:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823750528:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 8334us (8708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625857.448677:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1788625857.451667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625857.451994:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823750912 00000100:00100000:0.0:1788625857.452007:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823750912 00000100:00100000:0.0:1788625857.452117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:0.0:1788625857.452131:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+17:11560:x1875509823750912:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788625857.452379:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.452418:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.452433:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.452723:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.452982:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.452992:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.453040:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.453058:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 18 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625857.453074:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845767936:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625857.453311:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625857.457820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625857.458461:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845767936:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625857.458508:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.458661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823751040 00000100:00100000:2.0:1788625857.458671:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823751040 00010000:00010000:2.0:1788625857.458720:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.458965:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:2.0:1788625857.458977:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2365:x1875509823751040:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625857.458997:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625857.459004:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459037:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459066:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1430b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce11 expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459082:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:2.0:1788625857.459087:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459098:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459108:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.459142:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625857.459223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+18:2365:x1875509823751040:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 248us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.459232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00010000:00010000:3.0:1788625857.459409:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.459420:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625857.459672:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788625857.459879:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788625857.459926:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788625857.460031:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845768064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625857.460101:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625857.460140:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4360041480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625857.460171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845768064 00000100:00100000:3.0:1788625857.460179:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845768064 00000100:00100000:3.0:1788625857.460220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625857.460229:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875509845768064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625857.460621:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875509845768064:12345-0@lo:1000:mdt00_000.0 Request processed in 392us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.460631:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625857.460672:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788625857.460678:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b435166e300, transno 4294967315 00000100:00100000:3.0:1788625857.460693:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845768064:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788625857.461718:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788625857.462439:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845768192:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625857.462533:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625857.462572:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625857.462603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845768192 00000100:00100000:3.0:1788625857.462612:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845768192 00000100:00100000:3.0:1788625857.462660:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625857.462670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875509845768192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625857.463984:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875509845768192:12345-0@lo:1000:mdt00_000.0 Request processed in 1307us (1443us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788625857.463999:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625857.466425:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845768192:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788625857.466492:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466518:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466527:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466533:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625857.466538:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466546:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466567:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039200) 00010000:00010000:1.0:1788625857.466571:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625857.466577:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466583:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14351 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466625:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466632:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466651:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466657:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625857.466659:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466665:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466674:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:1.0:1788625857.466677:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625857.466680:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466685:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14286 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466712:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466792:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.466802:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.467029:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625857.467061:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 21 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625857.467077:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845768320:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625857.467190:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625857.477619:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.477669:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823751168 00000100:00100000:2.0:1788625857.477683:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823751168 00010000:00010000:2.0:1788625857.477772:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 22 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.477818:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:2.0:1788625857.477830:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2366:x1875509823751168:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625857.477869:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625857.477878:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 22 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.477893:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 22 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.477922:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:2.0:1788625857.477929:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.477940:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.477950:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.477974:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625857.478036:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:2366:x1875509823751168:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 208us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.478044:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00010000:00010000:3.0:1788625857.482094:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb142a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cdf5 expref: 21 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.482124:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845768320:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625857.482165:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486420:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486444:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486463:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486483:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486492:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486507:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625857.486512:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486522:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486547:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:2.0:1788625857.486550:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625857.486556:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486562:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c800/0x8aede7274cb14358 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486575:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486580:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486585:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486590:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625857.486599:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486605:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486614:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917bf00) 00010000:00010000:2.0:1788625857.486617:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625857.486620:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.486626:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1434a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.488967:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435166f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11560:x1875509823750912:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 36821us (37297us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788625857.488988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 186 00000020:00080000:2.0:1788625857.488997:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788625857.489362:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625857.489368:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625857.489894:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788625857.489905:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625857.496609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.496955:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823751424 00000100:00100000:3.0:1788625857.496969:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823751424 00000100:00100000:3.0:1788625857.497056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1788625857.497067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11560:x1875509823751424:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788625857.498536:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788625857.498660:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788625857.499420:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.499446:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.499462:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.499473:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.499480:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.499488:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.503941:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625857.504123:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:11560:x1875509823751424:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 7038us (7511us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788625857.504138:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000020:00080000:0.0:1788625857.504146:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788625857.504388:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625857.504400:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.504411:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625857.504417:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.504428:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.504450:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:2.0:1788625857.504454:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788625857.504479:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.504486:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1435f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.504521:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625857.504523:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625857.504525:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625857.704640:0:12470:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625857.704651:0:12470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625857.704691:0:12470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788625857.704701:0:12470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788625857.778872:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625857.856230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.856357:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823751680 00000100:00100000:3.0:1788625857.856367:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823751680 00000100:00100000:3.0:1788625857.856426:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:3.0:1788625857.856437:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:11569:x1875509823751680:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625857.856461:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625857.856525:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.856644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1436d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.856659:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1436d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.856671:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1436d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625857.856681:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788625857.857992:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce2d expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.859904:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1436d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce2d expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.859918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625857.859921:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625857.859925:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:3.0:1788625857.860010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:11569:x1875509823751680:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3574us (3790us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788625857.860019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:3.0:1788625857.862939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625857.862977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823751808 00000100:00100000:3.0:1788625857.862987:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823751808 00000100:00100000:3.0:1788625857.863039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1788625857.863049:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:11569:x1875509823751808:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1788625857.863142:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863160:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863173:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863196:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863203:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863438:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863447:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863454:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625857.863506:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863520:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863535:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863542:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863548:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625857.863553:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863560:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863572:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625857.863575:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625857.863580:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1437b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863601:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863607:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863613:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863618:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625857.863626:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863632:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863640:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4352039500) 00010000:00010000:3.0:1788625857.863643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625857.863645:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863651:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863671:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863676:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863681:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625857.863683:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863688:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4352039800) 00010000:00010000:3.0:1788625857.863697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625857.863708:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625857.863714:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625857.863806:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:11569:x1875509823751808:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 757us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625857.863815:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1788625857.940413:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625857.940540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823752064 00000100:00100000:0.0:1788625857.940550:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823752064 00000100:00100000:0.0:1788625857.940609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:0.0:1788625857.940620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+24:11573:x1875509823752064:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625857.940640:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625857.940661:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb14390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce34 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940781:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940796:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940809:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940854:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.940861:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941137:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941152:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625857.941160:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788625857.941242:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941249:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941261:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625857.941265:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941271:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941292:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625857.941294:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625857.941299:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941305:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb14397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941318:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941323:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941329:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941334:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625857.941337:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941342:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941349:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917b000) 00010000:00010000:0.0:1788625857.941351:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625857.941353:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941359:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743e00/0x8aede7274cb1439e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743c00/0x8aede7274cb14390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941427:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625857.941433:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625857.941435:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625857.941437:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743800, rc 0) 00000100:00100000:0.0:1788625857.941524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11573:x1875509823752064:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 905us (1134us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788625857.941534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:3.0:1788625857.948203:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625857.948313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823752192 00000100:00100000:2.0:1788625857.948323:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823752192 00000100:00100000:2.0:1788625857.948384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1788625857.948405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11573:x1875509823752192:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1788625857.948475:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948505:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948546:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948553:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948561:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948567:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625857.948589:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948597:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948610:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:2.0:1788625857.948613:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625857.948617:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625857.948624:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb143b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625857.948705:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11573:x1875509823752192:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 302us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625857.948713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1788625857.959563:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625857.959671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823752448 00000100:00100000:1.0:1788625857.959682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823752448 00000100:00100000:1.0:1788625857.959787:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:1.0:1788625857.959798:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11573:x1875509823752448:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625857.960040:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:11573:x1875509823752448:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 243us (486us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788625857.960049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:0.0:1788625858.039695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.044787:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823752704 00000100:00100000:3.0:1788625858.044808:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823752704 00000100:00100000:3.0:1788625858.044902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:3.0:1788625858.044916:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:11107:x1875509823752704:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625858.044949:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625858.044977:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb143ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.045113:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.045133:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.045144:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.045191:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.045229:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.045245:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845768448:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625858.045407:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625858.061350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625858.061599:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823752832 00000100:00100000:1.0:1788625858.061612:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823752832 00010000:00010000:1.0:1788625858.061671:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625858.061790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1788625858.061819:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:2366:x1875509823752832:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625858.061840:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625858.061848:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.061888:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.061928:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:1.0:1788625858.061936:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.061949:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.061958:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.061987:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625858.062064:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:2366:x1875509823752832:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 264us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625858.062072:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00010000:00010000:0.0:1788625858.062241:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce34 expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.062264:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845768448:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625858.062299:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.062311:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.062317:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625858.062345:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788625858.062610:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4340030600/0x8aede7274cb143ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.062631:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.062639:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625858.062643:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625858.062646:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:0.0:1788625858.062682:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:11107:x1875509823752704:12345-192.168.201.45@tcp:101:bash.0 Request processed in 17770us (23003us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788625858.062690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:1.0:1788625858.069540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.070016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753088 00000100:00100000:3.0:1788625858.070031:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753088 00000100:00100000:3.0:1788625858.070112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:3.0:1788625858.070125:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:11107:x1875509823753088:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1788625858.070850:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.070877:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.070892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625858.072398:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788625858.072454:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f45b3f0 reply state 0000000024ed7e6c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.072466:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788625858.072859:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788625858.073614:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11107:x1875509823753088:12345-192.168.201.45@tcp:36:bash.0 Request processed in 3482us (4080us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788625858.073626:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000020:00080000:3.0:1788625858.073648:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788625858.077767:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077793:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077801:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077807:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.077813:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077821:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077844:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625858.077847:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.077869:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.077877:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625858.084134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.088085:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753216 00000100:00100000:0.0:1788625858.088110:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753216 00000100:00100000:0.0:1788625858.088500:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:0.0:1788625858.088515:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:11107:x1875509823753216:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625858.088551:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.088580:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce42 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.088665:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce42 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.088685:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce42 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.088712:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625858.088716:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625858.088720:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743800, rc 0) 00000100:00100000:0.0:1788625858.088844:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11107:x1875509823753216:12345-192.168.201.45@tcp:101:bash.0 Request processed in 333us (4725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625858.088851:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:1.0:1788625858.094889:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625858.098018:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753344 00000100:00100000:2.0:1788625858.098042:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753344 00000100:00100000:2.0:1788625858.098230:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1788625858.098245:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:11107:x1875509823753344:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1788625858.098271:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625858.098360:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce49 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625858.098398:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c43c0, atime: 0x6a9c43be, ctime: 0x6a9c43c0, blocks: 0xb 00010000:00010000:2.0:1788625858.098428:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788625858.098447:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625858.098458:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.098482:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.098509:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b400, rc 0) 00000100:00100000:2.0:1788625858.098639:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:11107:x1875509823753344:12345-192.168.201.45@tcp:101:bash.0 Request processed in 396us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625858.098647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1788625858.109279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625858.109493:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753472 00000100:00100000:2.0:1788625858.109507:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753472 00002000:00010000:2.0:1788625858.109566:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788625858.109573:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43801fca80 with x1875509823753472 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625858.109588:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43801fca80. 00000100:00100000:2.0:1788625858.109629:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1788625858.109641:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2363:x1875509823753472:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:2.0:1788625858.110047:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788625858.110053:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788625856 -> 1788625858 00002000:00010000:2.0:1788625858.110056:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788625854 -> 1788625854 00002000:00010000:2.0:1788625858.110059:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788625856 -> 1788625858 00002000:00010000:2.0:1788625858.110062:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788625858.110151:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2363:x1875509823753472:12345-192.168.201.45@tcp:10:bash.0 Request processed in 510us (886us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788625858.112404:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00002000:00010000:2.0:1788625858.112431:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788625858.112436:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43801fca80 with x1875509823753472 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625858.112449:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43801fca80. 00000100:00100000:0.0:1788625858.247822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.247981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753600 00000100:00100000:3.0:1788625858.247996:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753600 00000100:00100000:3.0:1788625858.248086:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1788625858.248099:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11587:x1875509823753600:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1788625858.248212:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248235:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248249:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248268:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248275:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248282:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248618:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248629:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248636:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625858.248691:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248713:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248768:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248777:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248783:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625858.248788:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248797:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248812:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625858.248815:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625858.248821:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb143e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248843:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248850:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248857:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248869:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625858.248872:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248879:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248887:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4352039800) 00010000:00010000:3.0:1788625858.248890:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625858.248893:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248898:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb143eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248915:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248922:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625858.248937:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248943:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248962:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:3.0:1788625858.248964:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625858.248968:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.248974:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb143f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.249073:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11587:x1875509823753600:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 974us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.249083:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1788625858.312250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.312426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753856 00000100:00100000:0.0:1788625858.312438:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753856 00000100:00100000:0.0:1788625858.312544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:0.0:1788625858.312556:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11590:x1875509823753856:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625858.312585:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.312613:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb143f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312714:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312793:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312819:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.312825:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313146:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1440e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313158:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1440e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313166:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1440e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625858.313190:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788625858.313333:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313341:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313348:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313355:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.313360:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313370:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313384:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625858.313388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.313394:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313415:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313421:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313437:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313442:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.313445:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313451:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313458:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917b000) 00010000:00010000:0.0:1788625858.313460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.313463:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313468:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313534:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb143f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce50 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313549:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1440e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce50 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.313558:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625858.313560:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788625858.313563:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742000, rc 0) 00000100:00100000:0.0:1788625858.313657:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11590:x1875509823753856:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1102us (1421us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788625858.313675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:1.0:1788625858.330272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.330548:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823753984 00000100:00100000:3.0:1788625858.330561:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823753984 00000100:00100000:3.0:1788625858.330639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:3.0:1788625858.330652:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11590:x1875509823753984:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1788625858.330796:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.330817:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.330828:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.330874:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.330911:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 34 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.330929:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845768576:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625858.331060:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4360041480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625858.347377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.347631:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845768576:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625858.347669:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625858.348666:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823754240 00000100:00100000:1.0:1788625858.348679:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823754240 00000100:00100000:1.0:1788625858.348798:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1788625858.348811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:5603:x1875509823754240:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788625858.349282:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:5603:x1875509823754240:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 470us (1920us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788625858.349315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1788625858.359595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.359691:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823754368 00000100:00100000:3.0:1788625858.359707:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823754368 00010000:00010000:3.0:1788625858.359814:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 36 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.359860:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:3.0:1788625858.359873:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:2366:x1875509823754368:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625858.359895:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625858.359903:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 36 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.359920:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 36 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.359949:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb143c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce3b expref: 36 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.359991:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:3.0:1788625858.359997:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.360009:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.360018:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.360059:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625858.360127:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:2366:x1875509823754368:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 256us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.360136:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00010000:00010000:1.0:1788625858.360465:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360475:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360524:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360533:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360541:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360548:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625858.360553:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360562:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360572:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:1.0:1788625858.360575:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625858.360580:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.360587:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1441c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625858.360651:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11590:x1875509823753984:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 30001us (30393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625858.360660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:2.0:1788625858.363969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625858.364062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823754624 00000100:00100000:1.0:1788625858.364075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823754624 00000100:00100000:1.0:1788625858.364148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:1.0:1788625858.364161:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+34:11590:x1875509823754624:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625858.364623:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:11590:x1875509823754624:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 462us (666us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788625858.364633:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:3.0:1788625858.560797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.560925:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823754880 00000100:00100000:0.0:1788625858.560938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823754880 00000100:00100000:0.0:1788625858.561014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:0.0:1788625858.561028:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+35:11601:x1875509823754880:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:0.0:1788625858.561062:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.561090:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb14423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561205:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561237:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561244:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561251:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561615:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561637:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561646:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625858.561659:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788625858.561828:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561838:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561847:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561853:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.561859:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561868:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561883:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625858.561886:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.561892:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561900:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb1442a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561914:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561935:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561940:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.561944:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561951:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561960:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917b000) 00010000:00010000:0.0:1788625858.561963:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.561966:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.561973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.562027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb14423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce57 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.562044:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce57 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.562051:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:0.0:1788625858.562054:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625858.562063:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742a00, rc 0) 00000100:00100000:0.0:1788625858.562153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11601:x1875509823754880:12345-192.168.201.45@tcp:101:cat.0 Request processed in 1128us (1372us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788625858.562163:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:3.0:1788625858.571938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.572115:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823755136 00000100:00100000:0.0:1788625858.572130:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823755136 00000100:00100000:0.0:1788625858.572207:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1788625858.572220:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11601:x1875509823755136:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:0.0:1788625858.572724:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:11601:x1875509823755136:12345-192.168.201.45@tcp:35:cat.0 Request processed in 495us (791us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788625858.572764:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1788625858.611076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.611316:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823755392 00000100:00100000:3.0:1788625858.611330:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823755392 00000100:00100000:3.0:1788625858.611407:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:3.0:1788625858.611420:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:11602:x1875509823755392:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1788625858.611508:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788625858.611544:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce57 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611572:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742000/0x8aede7274cb1440e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce50 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611611:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743800/0x8aede7274cb143d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce42 expref: 36 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611623:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b435917b700) 00010000:00010000:3.0:1788625858.611637:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625858.611665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611682:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611712:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611720:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.611772:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612090:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612100:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612109:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625858.612777:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788625858.612791:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 408609061702ns, next at 409609058697ns, rc = 0 00010000:00010000:3.0:1788625858.612870:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612882:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612900:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612907:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612913:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612943:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625858.612971:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612977:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612985:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.612990:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625858.613006:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613016:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613029:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4352039500) 00010000:00010000:3.0:1788625858.613032:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788625858.613038:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613046:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb14454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613066:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613072:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613078:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613084:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625858.613087:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613093:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613101:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625858.613103:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625858.613112:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.613119:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14446 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625858.613130:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f8c84e3 reply state 0000000073dd520c transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.613140:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625858.613256:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+37:11602:x1875509823755392:12345-192.168.201.45@tcp:36:rm.0 Request processed in 1834us (2193us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788625858.613266:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00010000:00010000:2.0:1788625858.613751:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625858.613761:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.613770:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625858.613775:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.613782:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.613794:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b4352039500) 00010000:00010000:2.0:1788625858.613797:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788625858.613801:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.613809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb1445b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.613828:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625858.613830:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625858.613832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625858.617232:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617255:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617296:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617312:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625858.617318:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617329:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617352:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4352039800) 00010000:00010000:2.0:1788625858.617355:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625858.617362:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.617370:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1444d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625858.665410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.665596:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823755648 00000100:00100000:0.0:1788625858.665621:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823755648 00000100:00100000:0.0:1788625858.665703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:0.0:1788625858.665768:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+36:11608:x1875509823755648:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625858.665802:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.665831:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb14462 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666000:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666019:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666033:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666051:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.666084:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625858.667113:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788625858.667550:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667568:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667580:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667688:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667698:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667706:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667873:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625858.667878:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667886:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625858.667921:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625858.667928:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.667937:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625858.667953:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ca6cd6 reply state 00000000b9fa7f2b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.667964:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625858.668007:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb14462 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.668023:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.668030:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:0.0:1788625858.668033:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625858.668035:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742e00, rc 0) 00000100:00100000:0.0:1788625858.668551:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+39:11608:x1875509823755648:12345-192.168.201.45@tcp:101:bash.0 Request processed in 2835us (3155us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788625858.668563:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:2.0:1788625858.688045:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1788625858.688488:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688505:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688515:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688521:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625858.688528:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688538:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688563:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917b000) 00010000:00010000:1.0:1788625858.688567:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625858.688591:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.688599:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb14470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.688887:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823755776 00000100:00100000:3.0:1788625858.688900:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823755776 00000100:00100000:3.0:1788625858.688991:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1788625858.689005:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823755776:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625858.689027:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625858.689050:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce65 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625858.689083:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788625858.689108:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788625858.689113:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625858.689125:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.689147:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.689177:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3c00, rc 0) 00000100:00100000:3.0:1788625858.689249:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2363:x1875509823755776:12345-192.168.201.45@tcp:101:bash.0 Request processed in 248us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.689257:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00080000:2.0:1788625858.690040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625858.693699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.693823:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823755904 00000100:00100000:3.0:1788625858.693838:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823755904 00000100:00100000:3.0:1788625858.693914:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1788625858.693926:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:11608:x1875509823755904:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625858.693950:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625858.693972:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce6c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.694015:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.694026:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625858.694032:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625858.694039:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.694085:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.694103:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 7 pid: 8805 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.694143:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875509845768704:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625858.694272:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4360041480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625858.714128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.714249:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823756032 00000100:00100000:0.0:1788625858.714261:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823756032 00010000:00010000:0.0:1788625858.714328:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 8 pid: 8805 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.714400:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1788625858.714412:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823756032:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625858.714432:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625858.714462:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 8 pid: 8805 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.714490:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 8 pid: 8805 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.714522:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625858.714528:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625858.714538:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.714550:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.714603:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.714852:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b434fc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875509845768832:192.168.201.45@tcp:105: 00000100:00100000:0.0:1788625858.714946:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788625858.715250:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb14485 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce65 expref: 8 pid: 8805 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.715269:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875509845768704:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625858.715586:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.715603:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2400, rc 0) 00000100:00100000:3.0:1788625858.715883:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:11608:x1875509823755904:12345-192.168.201.45@tcp:101:bash.0 Request processed in 21958us (22201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.715892:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1788625858.719366:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b434fc05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875509845768832:192.168.201.45@tcp:105: 00010000:00010000:0.0:1788625858.719420:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625858.719504:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2365:x1875509823756032:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 5093us (5391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625858.719519:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:0.0:1788625858.734529:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625858.734967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823756288 00000100:00100000:1.0:1788625858.734982:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823756288 00000100:00100000:1.0:1788625858.735059:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:1.0:1788625858.735071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+38:11608:x1875509823756288:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1788625858.735559:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+39:11608:x1875509823756288:12345-192.168.201.45@tcp:35:bash.0 Request processed in 488us (1044us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788625858.735569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00010000:00010000:2.0:1788625858.802922:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625858.893612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625858.897145:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823756416 00000100:00100000:2.0:1788625858.897163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823756416 00000100:00100000:2.0:1788625858.897324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:2.0:1788625858.897337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+39:11624:x1875509823756416:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625858.897366:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625858.897390:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897497:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897520:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897533:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625858.897571:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788625858.897576:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625858.897595:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce73 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897640:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce73 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.897650:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625858.897652:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625858.897656:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94ac00, rc 0) 00000100:00100000:2.0:1788625858.897775:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11624:x1875509823756416:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 441us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625858.897783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:3.0:1788625858.904220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.904451:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823756672 00000100:00100000:0.0:1788625858.904543:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823756672 00000100:00100000:0.0:1788625858.904623:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:0.0:1788625858.904635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11624:x1875509823756672:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625858.904664:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.904695:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742c00/0x8aede7274cb144a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.905442:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.905542:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.905561:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625858.905577:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788625858.905893:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742c00/0x8aede7274cb144a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce7a expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.905918:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce7a expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.905950:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:0.0:1788625858.905953:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625858.905958:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743400, rc 0) 00000100:00100000:0.0:1788625858.906145:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+42:11624:x1875509823756672:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1510us (1942us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788625858.906154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:0.0:1788625858.910300:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.910357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.910435:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757056 00000100:00100000:3.0:1788625858.910448:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757056 00000100:00100000:3.0:1788625858.910546:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1788625858.910560:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+42:2363:x1875509823757056:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625858.910583:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625858.910619:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce7a expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.910666:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:3.0:1788625858.910675:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625858.910782:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+41:2363:x1875509823757056:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 225us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.910791:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1788625858.911658:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823756928 00000100:00100000:1.0:1788625858.911671:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823756928 00000100:00100000:1.0:1788625858.911761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:1.0:1788625858.911773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+41:11624:x1875509823756928:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625858.911802:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625858.911827:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb144b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.911952:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.911973:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.911988:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625858.912015:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788625858.912177:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb144b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce81 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.912199:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce81 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.912210:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:1.0:1788625858.912213:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788625858.912218:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d200, rc 0) 00000100:00100000:1.0:1788625858.912298:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:11624:x1875509823756928:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 527us (1939us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788625858.912306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:0.0:1788625858.918301:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.918421:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757184 00000100:00100000:3.0:1788625858.918435:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757184 00000100:00100000:3.0:1788625858.918558:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1788625858.918573:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+6:2366:x1875509823757184:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:3.0:1788625858.918638:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.918664:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.918674:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625858.918679:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625858.918685:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.918872:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.918892:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 6 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.918933:0:8805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1875509845768960:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625858.919079:0:8805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625858.922237:0:8805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1875509845768960:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625858.922297:0:8805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.923656:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.924134:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757312 00000100:00100000:3.0:1788625858.924149:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757312 00002000:00100000:3.0:1788625858.924224:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b434fc06680 x1875509823757312/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:669/0 lens 504/0 e 0 to 0 dl 1788625869 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625858.924236:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b434fc06680 with x1875509823757312 ext(0->8) 00010000:00010000:3.0:1788625858.924248:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 7 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.924339:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 7 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625858.924351:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b434fc06680 00000100:00100000:3.0:1788625858.924450:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1788625858.924464:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823757312:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1788625858.925452:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2366:x1875509823757312:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 984us (1799us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788625858.925465:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:3.0:1788625858.925494:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b434fc06680 x1875509823757312/t4294967308(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:669/0 lens 504/448 e 0 to 0 dl 1788625869 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625858.925504:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b434fc06680 with x1875509823757312 ext(0->8) 00010000:00010000:3.0:1788625858.925513:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.925530:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625858.925539:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b434fc06680 00000100:00100000:0.0:1788625858.928652:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625858.928940:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757440 00000100:00100000:1.0:1788625858.928953:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757440 00010000:00010000:1.0:1788625858.929073:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625858.929162:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1788625858.929175:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2366:x1875509823757440:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625858.929194:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788625858.929220:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788625858.929224:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788625858 00002000:00010000:1.0:1788625858.929226:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788625859 00002000:00010000:1.0:1788625858.929229:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788625858 00010000:00010000:1.0:1788625858.929236:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.929267:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.929310:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009023dc1b/0x8aede7274cb1448c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce6c expref: 9 pid: 6697 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.929337:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625858.929343:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625858.929351:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.929363:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625858.929403:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625858.929484:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823757440:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 312us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625858.929493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00010000:00010000:3.0:1788625858.929562:0:8805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929574:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929606:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929616:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929625:0:8805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929634:0:8805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625858.929650:0:8805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929662:0:8805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929677:0:8805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625858.929686:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023eddd32/0x8aede7274cb144cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625858.929785:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823757184:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 11215us (11501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625858.929795:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1788625858.932086:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625858.932208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757696 00000100:00100000:2.0:1788625858.932221:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757696 00000100:00100000:2.0:1788625858.932313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1788625858.932325:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+43:11624:x1875509823757696:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:2.0:1788625858.932413:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce81 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625858.932800:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788625858.932853:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788625858.933245:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788625858.933311:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.933331:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.933343:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.933390:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.933408:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 47 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625858.933426:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b42436d5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875509845769088:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625858.933559:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43489f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625858.937042:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.937127:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b42436d5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875509845769088:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625858.937165:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.937717:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757824 00000100:00100000:0.0:1788625858.937742:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757824 00010000:00010000:0.0:1788625858.937799:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 48 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625858.937850:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:0.0:1788625858.937862:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+48:2365:x1875509823757824:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625858.937883:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625858.937891:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 48 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.937908:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 48 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.937944:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742e00/0x8aede7274cb14477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce5e expref: 48 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.937982:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:0.0:1788625858.937989:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.938001:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.938022:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.938053:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625858.938119:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+47:2365:x1875509823757824:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 258us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625858.938129:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00010000:00010000:0.0:1788625858.938287:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.938296:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625858.938468:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788625858.938768:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788625858.938903:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845769216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788625858.938971:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625858.939000:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436038d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625858.939764:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845769216 00000100:00100000:2.0:1788625858.939777:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845769216 00000100:00100000:2.0:1788625858.939853:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625858.939879:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875509845769216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788625858.939993:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875509845769216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625858.940001:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788625858.940218:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625858.941534:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845769216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788625858.942209:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788625858.942468:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343590380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845769344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788625858.942569:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625858.942603:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625858.943171:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845769344 00000100:00100000:2.0:1788625858.943183:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845769344 00000100:00100000:2.0:1788625858.943254:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625858.943265:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875509845769344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788625858.943544:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1875509845769344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 280us (974us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788625858.943553:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625858.943609:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343590380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875509845769344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788625858.943691:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788625858.943786:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943800:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943811:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943819:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625858.943825:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943835:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943873:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:2.0:1788625858.943877:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788625858.943884:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625858.943892:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb144d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625858.944532:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788625858.944668:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788625858.944682:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408940952565ns, next at 409940949857ns, rc = 0 00000001:00080000:2.0:1788625858.944692:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788625858.945483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917be00) 00010000:00010000:2.0:1788625858.945491:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788625858.945507:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb144bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce81 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625858.945674:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:11624:x1875509823757696:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 13350us (13601us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788625858.945685:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000020:00080000:2.0:1788625858.945692:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788625858.949079:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625858.949177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823757952 00000100:00100000:0.0:1788625858.949191:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823757952 00000100:00100000:0.0:1788625858.949299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:0.0:1788625858.949314:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+50:11624:x1875509823757952:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625858.949356:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625858.949388:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.949480:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce88 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.949502:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce88 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625858.949528:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625858.949531:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625858.949537:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743400, rc 0) 00000100:00100000:0.0:1788625858.949620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11624:x1875509823757952:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 309us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625858.949629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:1.0:1788625858.953342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625858.953428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823758208 00000100:00100000:3.0:1788625858.953443:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823758208 00000100:00100000:3.0:1788625858.953521:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1788625858.953533:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+51:11624:x1875509823758208:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1788625858.953890:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11624:x1875509823758208:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 358us (563us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788625858.953919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1788625859.052343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.056924:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823758336 00000100:00100000:0.0:1788625859.056947:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823758336 00000100:00100000:0.0:1788625859.057271:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:0.0:1788625859.057287:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11634:x1875509823758336:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:0.0:1788625859.057405:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057444:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057479:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057504:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057512:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057520:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057653:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057662:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057670:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625859.057756:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057772:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057779:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057814:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057821:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.057826:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057836:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057850:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:0.0:1788625859.057854:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.057860:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057866:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb144e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057881:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057887:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057893:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057899:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.057902:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057919:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057929:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b435917be00) 00010000:00010000:0.0:1788625859.057932:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.057935:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057941:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb144e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057961:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057967:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057972:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057977:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.057980:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.057986:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.058224:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.058228:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.058232:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.058248:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb144ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.058362:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11634:x1875509823758336:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1075us (6032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.058371:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00080000:2.0:1788625859.059362:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625859.097309:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.097647:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823758592 00000100:00100000:1.0:1788625859.097662:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823758592 00000100:00100000:1.0:1788625859.097789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:1.0:1788625859.097802:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+52:11637:x1875509823758592:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625859.097831:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625859.097864:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb144f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.097985:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098010:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098026:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098045:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098053:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098061:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098229:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098239:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098246:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625859.098256:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788625859.098389:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098397:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098412:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098419:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625859.098425:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098434:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098450:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:1.0:1788625859.098453:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625859.098476:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098484:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d600/0x8aede7274cb144fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098499:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098504:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098510:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098515:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625859.098518:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098539:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098548:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625859.098551:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625859.098554:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d800/0x8aede7274cb14503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098612:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb144f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098628:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.098635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:1.0:1788625859.098637:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625859.098640:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4da00, rc 0) 00000100:00100000:1.0:1788625859.098775:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11637:x1875509823758592:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 974us (1481us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788625859.098782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:1.0:1788625859.101335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.105225:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823758720 00000100:00100000:3.0:1788625859.105245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823758720 00000100:00100000:3.0:1788625859.105330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:3.0:1788625859.105343:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11637:x1875509823758720:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1788625859.105439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105523:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105561:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105569:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105576:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105583:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625859.105589:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105598:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105633:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625859.105636:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625859.105643:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.105650:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.105797:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11637:x1875509823758720:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 456us (4474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625859.105813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:3.0:1788625859.107806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.107902:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823758976 00000100:00100000:1.0:1788625859.107915:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823758976 00000100:00100000:1.0:1788625859.107985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1788625859.108005:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+54:11637:x1875509823758976:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625859.108337:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11637:x1875509823758976:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 332us (541us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788625859.108346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:1.0:1788625859.185881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.186079:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823759232 00000100:00100000:3.0:1788625859.186093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823759232 00000100:00100000:3.0:1788625859.186175:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 207 00000100:00100000:3.0:1788625859.186187:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11647:x1875509823759232:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625859.186221:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.186226:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625859.186264:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ac00/0x8aede7274cb1449a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce73 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625859.186303:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625859.186321:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb1451f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186451:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186494:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186504:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186549:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.186565:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 55 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.186581:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845769472:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625859.187509:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4341377300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.197246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.197394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823759360 00000100:00100000:0.0:1788625859.197408:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823759360 00010000:00010000:0.0:1788625859.197478:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 56 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.197531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:0.0:1788625859.197543:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:2366:x1875509823759360:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625859.197562:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625859.197571:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 56 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.197588:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 56 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.197619:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.197625:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.197639:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.197671:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.197698:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625859.197792:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+56:2366:x1875509823759360:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 249us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.197801:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00010000:00010000:3.0:1788625859.200582:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4da00/0x8aede7274cb1450a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce8f expref: 55 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.200613:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845769472:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625859.200646:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.200658:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.200664:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625859.200695:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788625859.201836:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb1451f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.202039:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.202050:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625859.202053:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625859.202057:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3c00, rc 0) 00000100:00100000:3.0:1788625859.202686:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11647:x1875509823759232:12345-192.168.201.45@tcp:101:bash.0 Request processed in 15972us (16295us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788625859.202703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 207 00000100:00100000:1.0:1788625859.210710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.211179:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823759616 00000100:00100000:0.0:1788625859.211194:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823759616 00000100:00100000:0.0:1788625859.211351:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:0.0:1788625859.211365:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+55:11647:x1875509823759616:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:0.0:1788625859.211807:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.211833:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.211862:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625859.211938:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788625859.211970:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bab30001 reply state 00000000cdd9c4ac transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.211981:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625859.212122:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11647:x1875509823759616:12345-192.168.201.45@tcp:36:bash.0 Request processed in 757us (1425us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788625859.212130:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 208 00000020:00080000:0.0:1788625859.212136:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788625859.217721:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217768:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217800:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217807:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625859.217814:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217825:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217975:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625859.217980:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625859.217986:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.217995:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742200/0x8aede7274cb14534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625859.235237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.235530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823759744 00000100:00100000:0.0:1788625859.235544:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823759744 00000100:00100000:0.0:1788625859.235626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:0.0:1788625859.235640:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11647:x1875509823759744:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1788625859.235675:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625859.235706:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb1453b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ce9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.236071:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.236090:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.236099:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.236143:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.236161:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 58 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.236177:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845769600:192.168.201.45@tcp:104: 00000100:00100000:0.0:1788625859.236631:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436eae6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.244824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.245081:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4343591c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845769600:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625859.245124:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.245544:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823759872 00000100:00100000:2.0:1788625859.245553:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823759872 00010000:00010000:2.0:1788625859.245603:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 59 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.245702:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:2.0:1788625859.245715:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:2365:x1875509823759872:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625859.245769:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625859.245778:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 59 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245808:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 59 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245838:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce96 expref: 59 pid: 5841 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245870:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625859.245876:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245887:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245904:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.245931:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625859.246008:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:2365:x1875509823759872:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 294us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.246016:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00010000:00010000:0.0:1788625859.246079:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.246088:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625859.246156:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788625859.246163:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625859.246191:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.246244:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb1453b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.246260:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.246267:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.246281:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625859.246283:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743a00, rc 0) 00000100:00100000:0.0:1788625859.246314:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11647:x1875509823759744:12345-192.168.201.45@tcp:101:bash.0 Request processed in 10678us (11104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.246322:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:1.0:1788625859.259662:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.259869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760128 00000100:00100000:3.0:1788625859.259884:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760128 00000100:00100000:3.0:1788625859.259968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1788625859.259981:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+57:11647:x1875509823760128:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1788625859.260320:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11647:x1875509823760128:12345-192.168.201.45@tcp:35:bash.0 Request processed in 340us (672us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788625859.260330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1788625859.322283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.322407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760256 00000100:00100000:3.0:1788625859.322419:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760256 00000100:00100000:3.0:1788625859.322501:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:3.0:1788625859.322513:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+58:11654:x1875509823760256:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625859.322549:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.322578:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cea4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.322863:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.322881:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.322894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625859.322943:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788625859.322947:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625859.322969:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.323001:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cea4 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.323029:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cea4 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.323038:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625859.323041:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625859.323046:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2000, rc 0) 00000100:00100000:3.0:1788625859.323115:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823760256:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 605us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625859.323123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:1.0:1788625859.326916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.327005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760384 00000100:00100000:3.0:1788625859.327032:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760384 00000100:00100000:3.0:1788625859.327130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:3.0:1788625859.327144:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823760384:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625859.327170:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.327196:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ceab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327284:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327303:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327318:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327334:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327342:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327349:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327461:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327483:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327490:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625859.327551:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788625859.327556:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625859.327579:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327593:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327601:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327608:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327615:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.327620:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625859.328337:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328350:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328369:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625859.328372:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625859.328379:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328387:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb1455e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328421:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328428:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328435:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328441:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625859.328444:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328451:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328459:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4352039400) 00010000:00010000:3.0:1788625859.328462:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625859.328476:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328483:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328535:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceab expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328552:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceab expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.328586:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625859.328589:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625859.328592:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625859.328931:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437b4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11654:x1875509823760384:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1787us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625859.328942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:1.0:1788625859.334420:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.334556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.334647:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760768 00000100:00100000:0.0:1788625859.334662:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760768 00000100:00100000:0.0:1788625859.334789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:0.0:1788625859.334802:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:2366:x1875509823760768:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625859.334822:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625859.334865:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb1456c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceab expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.334885:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.334892:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625859.334966:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:2366:x1875509823760768:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 167us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.334975:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1788625859.335858:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760640 00000100:00100000:3.0:1788625859.335868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760640 00000100:00100000:3.0:1788625859.336232:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:3.0:1788625859.336246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823760640:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625859.336282:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.336308:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb14573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ceb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.336463:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.336491:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.336502:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.336546:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.336563:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 60 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.336589:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845769728:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625859.336725:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4342dbc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625859.339256:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845769728:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625859.339306:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625859.343593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.343817:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823760896 00000100:00100000:3.0:1788625859.343833:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823760896 00010000:00010000:3.0:1788625859.343889:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 61 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.343948:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1788625859.343959:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:2365:x1875509823760896:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625859.343977:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625859.343984:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 61 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.343999:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 61 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.344409:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb14542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce9d expref: 61 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.344428:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625859.344435:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.344460:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.344480:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.344607:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625859.344686:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:2365:x1875509823760896:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 727us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625859.344695:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00010000:00010000:2.0:1788625859.346034:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.346055:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625859.346087:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788625859.346635:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7400/0x8aede7274cb14573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.346683:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.346695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625859.346698:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625859.346712:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7800, rc 0) 00000100:00100000:2.0:1788625859.346822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11654:x1875509823760640:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 10579us (12414us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788625859.346833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:1.0:1788625859.350406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.350519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761152 00000100:00100000:0.0:1788625859.350534:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761152 00000100:00100000:0.0:1788625859.350622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1788625859.350634:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4357255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11654:x1875509823761152:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:0.0:1788625859.350655:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625859.350690:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb144d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce88 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.350722:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.350763:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625859.350832:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4357255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823761152:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 201us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.350841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625859.353501:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.353589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761280 00000100:00100000:0.0:1788625859.353602:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761280 00000100:00100000:0.0:1788625859.353679:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:0.0:1788625859.353690:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823761280:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:0.0:1788625859.353884:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.353926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.353943:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625859.354207:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788625859.354310:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823761280:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 621us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.354319:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:1.0:1788625859.357557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.357669:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761408 00000100:00100000:0.0:1788625859.357682:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761408 00000100:00100000:0.0:1788625859.357784:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:0.0:1788625859.357798:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+59:11654:x1875509823761408:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625859.357828:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625859.357858:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ceb9 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.357943:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.357958:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.357982:0:6721:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.357998:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.358048:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.358052:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625859.358058:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.358067:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743400, rc 0) 00000100:00100000:0.0:1788625859.358140:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11654:x1875509823761408:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 345us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.358148:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 214 00000040:00080000:1.0:1788625859.571208:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625859.571223:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625859.571294:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788625859.571303:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625859.571489:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845769856:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625859.571942:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.578353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.578559:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761536 00000100:00100000:2.0:1788625859.578573:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761536 00000100:00100000:2.0:1788625859.578657:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:2.0:1788625859.578668:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823761536:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625859.578786:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625859.578925:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823761536:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 257us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.578934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:0.0:1788625859.579323:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845769856:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625859.582063:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.583116:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761664 00000100:00100000:0.0:1788625859.583134:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761664 00000100:00100000:0.0:1788625859.583294:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:0.0:1788625859.583307:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11655:x1875509823761664:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788625859.583415:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.583436:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.583451:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584087:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584114:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584144:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584179:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584188:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584303:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625859.584357:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788625859.584362:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625859.584378:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584391:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584398:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584406:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584412:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.584417:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584425:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584450:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:0.0:1788625859.584452:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.584458:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584476:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742400/0x8aede7274cb14596 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584493:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584499:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584504:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584510:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.584513:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584519:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584527:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b435917be00) 00010000:00010000:0.0:1788625859.584529:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.584532:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584830:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743600/0x8aede7274cb1459d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584858:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584864:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584870:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584875:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625859.584877:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584884:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584891:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625859.584894:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625859.584897:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.584903:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742800/0x8aede7274cb145a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.585420:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11655:x1875509823761664:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 2109us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.585431:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:1.0:1788625859.592986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.593151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823761920 00000100:00100000:2.0:1788625859.593162:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823761920 00000100:00100000:2.0:1788625859.593240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:2.0:1788625859.593252:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+60:11655:x1875509823761920:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625859.593273:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625859.593295:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cec0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593423:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593439:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593451:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625859.593476:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788625859.593584:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593592:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593598:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593603:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625859.593607:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593615:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593628:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625859.593631:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788625859.593636:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593652:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593705:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145ab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cec0 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.593716:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:2.0:1788625859.593719:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625859.593723:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cec0 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.594560:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b800, rc 0) 00000100:00100000:2.0:1788625859.594627:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823761920:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1377us (1651us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788625859.594635:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:1.0:1788625859.601680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.601767:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823762048 00000100:00100000:0.0:1788625859.601776:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823762048 00000100:00100000:0.0:1788625859.601830:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:0.0:1788625859.601857:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823762048:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625859.601896:0:6721:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625859.602013:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823762048:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 157us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.602022:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:3.0:1788625859.612691:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.616764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823762304 00000100:00100000:1.0:1788625859.616805:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823762304 00000100:00100000:1.0:1788625859.616963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:1.0:1788625859.616975:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823762304:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625859.616996:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625859.616999:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788625859.617026:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cea4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617053:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:1.0:1788625859.617059:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625859.617074:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cec7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788625859.617527:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788625859.617805:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb145c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617820:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb145c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617832:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb145c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617886:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cec7 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617903:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb145c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cec7 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.617926:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:1.0:1788625859.617930:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625859.617933:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c600, rc 0) 00000100:00100000:1.0:1788625859.618012:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11655:x1875509823762304:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1039us (5333us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788625859.618020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:0.0:1788625859.625358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.638130:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823762560 00000100:00100000:2.0:1788625859.638145:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823762560 00000100:00100000:2.0:1788625859.638381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:2.0:1788625859.638393:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11655:x1875509823762560:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625859.638453:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625859.638493:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c600/0x8aede7274cb145c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cec7 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638511:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4348a9f000) 00010000:00010000:2.0:1788625859.638522:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625859.638557:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638604:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638653:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638660:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638756:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638764:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638770:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638775:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625859.638779:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638787:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638796:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:2.0:1788625859.638806:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625859.638810:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638816:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb145d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638826:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638831:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638836:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638841:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625859.638843:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638849:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638856:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb2e96e45 (ffff9b4356b43500) 00010000:00010000:2.0:1788625859.638858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625859.638861:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.638867:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb145dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2e96e45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.638973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823762560:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 581us (13629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625859.638986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:1.0:1788625859.648717:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.648914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823762688 00000100:00100000:2.0:1788625859.648924:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823762688 00000100:00100000:2.0:1788625859.649001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:2.0:1788625859.649018:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+61:11655:x1875509823762688:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625859.649043:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625859.649069:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb145e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cece expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649126:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649141:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649154:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649590:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb145e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649617:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.649626:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:2.0:1788625859.649629:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625859.649633:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b000, rc 0) 00000100:00100000:2.0:1788625859.649700:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11655:x1875509823762688:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 687us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.649715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:2.0:1788625859.662133:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.662287:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823762944 00000100:00100000:1.0:1788625859.662302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823762944 00000100:00100000:1.0:1788625859.662380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:1.0:1788625859.662394:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+62:11655:x1875509823762944:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625859.662539:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.662563:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.662580:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625859.663253:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788625859.663270:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409659541094ns, next at 410659538272ns, rc = 0 00000004:00010000:0.0:1788625859.663373:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0965e27 reply state 000000009513fc0b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.663386:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625859.663528:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+64:11655:x1875509823762944:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1132us (1410us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788625859.663549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 222 00010000:00010000:1.0:1788625859.680447:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680497:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680506:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680530:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4de00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625859.680550:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680561:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680582:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:1.0:1788625859.680585:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788625859.680591:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.680598:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb145f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.690281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.690602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763072 00000100:00100000:3.0:1788625859.690616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763072 00000100:00100000:3.0:1788625859.690692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:3.0:1788625859.690712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+63:11655:x1875509823763072:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625859.690796:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.690827:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ced5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.690908:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.690928:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.690954:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:3.0:1788625859.690972:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625859.690978:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7200, rc 0) 00000100:00100000:3.0:1788625859.691059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+64:11655:x1875509823763072:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 349us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625859.691068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:0.0:1788625859.695722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.695873:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763200 00000100:00100000:2.0:1788625859.695890:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763200 00000100:00100000:2.0:1788625859.696012:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1788625859.696025:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823763200:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788625859.696446:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2365:x1875509823763200:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 422us (2265us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788625859.696456:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00080000:0.0:1788625859.697929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625859.700956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.701044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763456 00000100:00100000:3.0:1788625859.701060:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763456 00000100:00100000:3.0:1788625859.701191:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1788625859.701205:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+64:11655:x1875509823763456:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788625859.701560:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+65:11655:x1875509823763456:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 356us (621us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788625859.701569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:1.0:1788625859.735510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625859.740106:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763712 00000100:00100000:3.0:1788625859.740129:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763712 00000100:00100000:2.0:1788625859.740601:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:2.0:1788625859.740615:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+65:11655:x1875509823763712:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625859.740810:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+65:11655:x1875509823763712:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 196us (5315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.740819:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:0.0:1788625859.747940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.748395:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763840 00000100:00100000:2.0:1788625859.748410:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763840 00000100:00100000:2.0:1788625859.748494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:2.0:1788625859.748506:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+65:11655:x1875509823763840:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625859.748535:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625859.748564:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb145ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cedc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748700:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748716:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625859.748817:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625859.748844:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748881:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb145ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cedc expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748913:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cedc expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.748924:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:2.0:1788625859.748927:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788625859.748932:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a000, rc 0) 00000100:00100000:2.0:1788625859.749005:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+66:11655:x1875509823763840:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 500us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.749014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:1.0:1788625859.757064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.757163:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823763968 00000100:00100000:2.0:1788625859.757178:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823763968 00000100:00100000:2.0:1788625859.757247:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1788625859.757259:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+10:2363:x1875509823763968:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625859.757287:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625859.757330:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cee3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625859.757367:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c43c3, blocks: 0x1 00010000:00010000:2.0:1788625859.757399:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1788625859.757404:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625859.757415:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.757438:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.757456:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b800, rc 0) 00000100:00100000:2.0:1788625859.757558:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:2363:x1875509823763968:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 301us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.757566:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:1.0:1788625859.760328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.763486:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764224 00000100:00100000:2.0:1788625859.763508:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764224 00000100:00100000:2.0:1788625859.763620:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:2.0:1788625859.763799:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+66:11655:x1875509823764224:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625859.763961:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+66:11655:x1875509823764224:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 166us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.763969:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:0.0:1788625859.769252:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.769540:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764352 00000100:00100000:2.0:1788625859.769554:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764352 00000100:00100000:3.0:1788625859.769930:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1788625859.769949:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+11:11655:x1875509823764352:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625859.769975:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625859.770072:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ceea expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.770116:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.770127:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625859.770131:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625859.770138:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.770281:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625859.770298:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 12 pid: 6698 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625859.770318:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4350f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875509845769984:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625859.770619:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4342dbc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.779293:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.779510:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764480 00000100:00100000:0.0:1788625859.779523:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764480 00000100:00100000:2.0:1788625859.779549:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4350f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875509845769984:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625859.779578:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 13 pid: 6698 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.779610:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.779632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00010000:00010000:2.0:1788625859.779642:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7400, rc 0) 00000100:00100000:0.0:1788625859.779642:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823764480:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625859.779660:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625859.779707:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 13 pid: 6698 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.779714:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:11655:x1875509823764352:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 9773us (10478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.779722:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:0.0:1788625859.779722:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 13 pid: 6698 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.779783:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019235b31/0x8aede7274cb1460d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cee3 expref: 12 pid: 6698 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.779798:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625859.779802:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625859.779812:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.779823:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.779867:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.779885:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875509845770112:192.168.201.45@tcp:105: 00000100:00100000:0.0:1788625859.779952:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43454186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.788569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.790884:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1875509845770112:192.168.201.45@tcp:105: 00010000:00010000:0.0:1788625859.790924:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625859.791474:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764608 00000100:00100000:2.0:1788625859.791486:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764608 00002000:00100000:2.0:1788625859.791555:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b437f904700 x1875509823764608/t0(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:670/0 lens 504/0 e 0 to 0 dl 1788625870 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625859.791567:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f904700 with x1875509823764608 ext(0->12) 00002000:00010000:2.0:1788625859.791573:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f904700 00000100:00100000:2.0:1788625859.791621:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1788625859.791633:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+12:2365:x1875509823764608:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788625859.792335:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2365:x1875509823764480:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 12689us (13052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625859.792358:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:2.0:1788625859.796023:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2365:x1875509823764608:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 4370us (7452us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788625859.796045:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00002000:00100000:2.0:1788625859.796064:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b437f904700 x1875509823764608/t4294967320(0) o4->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:670/0 lens 504/448 e 0 to 0 dl 1788625870 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625859.796077:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b437f904700 with x1875509823764608 ext(0->12) 00002000:00010000:2.0:1788625859.796084:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b437f904700 00000100:00100000:2.0:1788625859.804017:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625859.806058:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764736 00000100:00100000:0.0:1788625859.806078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764736 00000100:00100000:0.0:1788625859.806256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:0.0:1788625859.806268:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+66:11655:x1875509823764736:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788625859.828287:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788625859.846007:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788625859.846029:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788625859.846059:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b4347918d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788625859.846067:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b437fc6cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b43602d4a80 00000020:00080000:1.0:1788625859.846071:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b437fc6cb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b436eaf1c00 00000020:00080000:1.0:1788625859.846280:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788625859.846292:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845770368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788625859.846293:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845770240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788625859.848131:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625859.848346:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845770368 00000100:00100000:2.0:1788625859.848370:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845770368 00000100:00100000:2.0:1788625859.848447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625859.848472:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875509845770368:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788625859.848652:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625859.848668:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625859.848704:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845770240 00000100:00100000:0.0:1788625859.848708:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845770240 00000100:00100000:0.0:1788625859.848748:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00002000:00010000:2.0:1788625859.848751:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788625859.848755:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788625859 00000100:00100000:0.0:1788625859.848756:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875509845770240:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788625859.848758:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788625859.848761:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788625859 -> 1788625859 00002000:00010000:2.0:1788625859.848763:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00080000:0.0:1788625859.848772:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788625859.848794:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.848820:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1875509845770368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 364us (698us total) trans 4294967321 rc 0/0 00010000:00010000:0.0:1788625859.848821:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.848832:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00000100:00100000:2.0:1788625859.848838:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788625859.848838:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625859.848845:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.848887:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625859.848912:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 12 pid: 6696 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.848929:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845770496:192.168.201.45@tcp:104: 00000020:00080000:3.0:1788625859.849105:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788625859.849184:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788625859.849196:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1788625859.849315:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b437f906300/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788625859.849325:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845770368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788625859.849364:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:1.0:1788625859.849576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b42436d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+40:11655:x1875509823764736:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 43308us (45573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625859.849586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:0.0:1788625859.849642:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4345418f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625859.852405:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845770624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788625859.852520:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625859.852769:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845770624 00000100:00100000:2.0:1788625859.852779:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845770624 00000100:00100000:2.0:1788625859.852850:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625859.852862:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845770624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788625859.852897:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788625859.852940:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c43c2, atime: 0x6a9c43c3, ctime: 0x6a9c43c2, blocks: 0x1 00010000:00010000:2.0:1788625859.852949:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.852969:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1788625859.852974:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625859.852981:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.853001:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.853038:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.853047:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625859.853074:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788625859.853776:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1875509845770624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 913us (1254us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788625859.853787:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788625859.854205:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625859.854216:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.854228:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ae00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625859.854234:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.854245:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.854269:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.854278:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13c7d2b/0x8aede7274cb14622 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.854311:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625859.854325:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625859.854327:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625859.854665:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b4347cdad80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788625859.854675:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845770624:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788625859.854921:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788625859.854940:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788625859.854980:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b42410a0480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788625859.854985:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4379c43200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b42410a00c0 00000020:00080000:3.0:1788625859.854988:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b4379c43a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b43510b3c00 00000020:00080000:3.0:1788625859.855137:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788625859.855350:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788625859.855839:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379defb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845770496:192.168.201.45@tcp:104: 00010000:00010000:0.0:1788625859.855869:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625859.856910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625859.856990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625859.857365:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764992 00000100:00100000:0.0:1788625859.857365:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823764864 00000100:00100000:0.0:1788625859.857376:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764864 00000100:00100000:1.0:1788625859.857377:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823764992 00010000:00010000:1.0:1788625859.857423:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 14 pid: 6696 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625859.857441:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:0.0:1788625859.857453:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2364:x1875509823764864:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788625859.857467:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1788625859.857474:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+14:2366:x1875509823764992:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625859.857491:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625859.857497:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 14 pid: 6696 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857511:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 14 pid: 6696 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857597:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019b5ecea/0x8aede7274cb143dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce49 expref: 14 pid: 6696 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857616:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625859.857621:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625859.857628:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857639:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857687:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625859.857721:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857751:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857763:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857771:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857790:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625859.857941:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625859.857949:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857958:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625859.857964:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857974:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.857998:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.858005:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb1461b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625859.858219:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625859.858221:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625859.858223:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625859.860137:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875509845770240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11373us (11459us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788625859.860153:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625859.860272:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+13:2366:x1875509823764992:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2782us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625859.860282:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000004:00080000:2.0:1788625859.860970:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b437f905f80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788625859.860981:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845770240:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788625859.993664:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788625859.993890:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788625859.994216:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823764864:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 136754us (137301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625859.994231:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1788625860.005601:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625860.005799:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823765248 00000100:00100000:0.0:1788625860.005815:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823765248 00000100:00100000:0.0:1788625860.005892:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:0.0:1788625860.005903:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11655:x1875509823765248:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625860.005983:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625860.006025:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cedc expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.006075:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:0.0:1788625860.006083:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625860.006127:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.006144:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.006157:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625860.006964:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6436132 reply state 00000000705e7b88 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625860.006980:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625860.007119:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:11655:x1875509823765248:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1216us (1547us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788625860.007127:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:1.0:1788625860.017658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.018101:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823765376 00000100:00100000:3.0:1788625860.018115:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823765376 00000100:00100000:3.0:1788625860.018190:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:3.0:1788625860.018202:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823765376:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788625860.018495:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788625860.018499:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788625859 -> 1788625859 00002000:00010000:3.0:1788625860.018502:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788625859 00002000:00010000:3.0:1788625860.018518:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788625859 -> 1788625859 00002000:00010000:3.0:1788625860.018521:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788625860.018612:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823765376:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 412us (969us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788625860.019072:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00010000:00010000:2.0:1788625860.020904:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.020927:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.020936:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.020963:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625860.020970:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.020979:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.021000:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:2.0:1788625860.021004:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625860.021010:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.021017:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742a00/0x8aede7274cb14629 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.029030:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.029374:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823765632 00000100:00100000:2.0:1788625860.029390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823765632 00000100:00100000:2.0:1788625860.029481:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1788625860.029495:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11655:x1875509823765632:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788625860.029622:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.029644:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.029656:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.029703:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.029776:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 20 pid: 5842 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625860.029797:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845770752:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625860.029918:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625860.036306:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875509845770752:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625860.036354:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.043245:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.043979:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823765760 00000100:00100000:3.0:1788625860.043991:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823765760 00010000:00010000:3.0:1788625860.044039:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 21 pid: 5842 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625860.044133:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1788625860.044144:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:2365:x1875509823765760:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625860.044159:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625860.044166:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 21 pid: 5842 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044180:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 21 pid: 5842 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044203:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb145ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cece expref: 21 pid: 5842 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044221:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:3.0:1788625860.044226:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044236:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044273:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.044310:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625860.044373:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:2365:x1875509823765760:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 230us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625860.044380:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00010000:00010000:2.0:1788625860.046774:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046791:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046834:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046843:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046851:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046857:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625860.046862:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046896:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046914:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:2.0:1788625860.046917:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788625860.046922:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.046929:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14630 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625860.047037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11655:x1875509823765632:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 17539us (18016us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788625860.047047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1788625860.059148:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625860.059355:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823765888 00000100:00100000:1.0:1788625860.059365:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823765888 00000100:00100000:1.0:1788625860.059424:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1788625860.059435:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2366:x1875509823765888:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788625860.059497:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.059519:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.059547:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788625860.059552:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625860.059557:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.059598:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.059613:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 8 pid: 6697 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.059628:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845770880:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625860.059750:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43520ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625860.064285:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875509845770880:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625860.064323:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625860.065310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625860.065558:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823766016 00000100:00100000:0.0:1788625860.065567:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823766016 00010000:00010000:0.0:1788625860.065606:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 9 pid: 6697 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625860.065635:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:0.0:1788625860.065643:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+9:2365:x1875509823766016:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625860.065657:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625860.065678:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 9 pid: 6697 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.065714:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 9 pid: 6697 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.065755:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7d1416/0x8aede7274cb14614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceea expref: 9 pid: 6697 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.065772:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625860.065777:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625860.065782:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.065792:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.065817:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625860.065924:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2365:x1875509823766016:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 281us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625860.065931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00010000:00010000:3.0:1788625860.066164:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066174:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066197:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066204:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066213:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066220:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625860.066224:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066246:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066263:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.066271:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb14637 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625860.066325:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2366:x1875509823765888:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 6892us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625860.066333:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:3.0:1788625860.074299:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625860.074660:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823766272 00000100:00100000:1.0:1788625860.074670:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823766272 00000100:00100000:1.0:1788625860.074783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:1.0:1788625860.074794:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11655:x1875509823766272:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788625860.074884:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.074902:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.074915:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.075506:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.075520:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.075528:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.075565:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.075581:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 20 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.075595:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845771008:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625860.075948:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625860.084358:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625860.084489:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625860.084597:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845771136 00000100:00100000:3.0:1788625860.084614:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845771136 00000100:00100000:3.0:1788625860.084670:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788625860.084679:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625860.084702:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788625860.084777:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875509845771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625860.084784:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625860.085946:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788625860.085955:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788625860.085976:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b437f906300, transno 4294967321 00000100:00100000:0.0:1788625860.086005:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b437f905f80 x1875509845770240/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788625875 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625860.086028:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625860.086781:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845771008:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625860.086807:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625860.089213:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625860.089322:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823766400 00000100:00100000:0.0:1788625860.089347:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823766400 00010000:00010000:0.0:1788625860.089390:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 21 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625860.089433:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1788625860.089443:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:2365:x1875509823766400:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625860.089627:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625860.089635:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 21 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089648:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 21 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089672:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7200/0x8aede7274cb145f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ced5 expref: 21 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089704:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:0.0:1788625860.089710:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089719:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089781:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.089804:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625860.089871:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:2365:x1875509823766400:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 429us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625860.089888:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00010000:00010000:1.0:1788625860.090127:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.090136:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625860.090334:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788625860.090526:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788625860.090569:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788625860.090647:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845771264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788625860.090799:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625860.091110:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625860.091435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845771264 00000100:00100000:0.0:1788625860.091444:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845771264 00000100:00100000:0.0:1788625860.091494:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625860.091504:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875509845771264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788625860.091598:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875509845771264:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625860.091606:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625860.095427:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845771264:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788625860.096054:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788625860.096138:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845771392:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788625860.096201:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625860.096241:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625860.096464:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845771392 00000100:00100000:0.0:1788625860.096471:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845771392 00000100:00100000:0.0:1788625860.096524:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625860.096533:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875509845771392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788625860.096758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875509845771392:12345-0@lo:1000:mdt00_000.0 Request processed in 226us (556us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788625860.096766:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625860.097439:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875509845771392:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788625860.097487:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097497:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097511:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625860.097515:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097523:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097540:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43300) 00010000:00010000:1.0:1788625860.097543:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625860.097563:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097569:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14645 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097602:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097608:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097614:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097620:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625860.097622:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097628:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097636:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:1.0:1788625860.097639:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625860.097646:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097659:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097668:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.097721:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.097758:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845771520:192.168.201.45@tcp:105: 00000100:00100000:1.0:1788625860.097839:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625860.101340:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875509845771520:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625860.101373:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101384:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743200/0x8aede7274cb14588 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101417:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101430:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101442:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101462:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101469:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101475:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101503:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625860.101507:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101515:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101526:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:1.0:1788625860.101529:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625860.101533:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101539:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d000/0x8aede7274cb1464c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101549:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101561:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101565:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4dc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625860.101568:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101574:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101591:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:1.0:1788625860.101594:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625860.101597:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.101602:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb1463e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625860.102115:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11655:x1875509823766272:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 27321us (27823us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788625860.102126:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00000020:00080000:1.0:1788625860.102131:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788625860.105724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.105934:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823766528 00000100:00100000:2.0:1788625860.105946:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823766528 00000100:00100000:2.0:1788625860.106004:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1788625860.106024:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11654:x1875509823766528:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:2.0:1788625860.106164:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11654:x1875509823766528:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 141us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625860.106171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1788625860.109816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.111040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823766784 00000100:00100000:3.0:1788625860.111055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823766784 00000100:00100000:3.0:1788625860.111115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:3.0:1788625860.111125:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:11655:x1875509823766784:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788625860.112419:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1788625860.112661:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.112878:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823767040 00000100:00100000:2.0:1788625860.112886:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823767040 00000100:00100000:2.0:1788625860.112935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:2.0:1788625860.112944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:11654:x1875509823767040:12345-192.168.201.45@tcp:58:lfs.0 00000040:00080000:2.0:1788625860.113233:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788625860.113431:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:11654:x1875509823767040:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 487us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625860.113449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 231 00000001:00080000:2.0:1788625860.114185:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788625860.114245:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114272:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114283:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114291:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114297:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114303:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.114328:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788625860.114395:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:11655:x1875509823766784:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 3270us (4588us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788625860.114415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000020:00080000:2.0:1788625860.114419:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788625860.114522:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625860.114529:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.114536:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625860.114540:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.114548:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.114561:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b4356b43400) 00010000:00010000:1.0:1788625860.114563:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788625860.114568:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.114573:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b600/0x8aede7274cb14653 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625860.114598:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625860.114601:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625860.114603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625860.116179:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625860.116187:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625860.116221:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788625860.116228:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625860.116348:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845771648:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625860.116411:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4344dda180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625860.126909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625860.127054:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823767168 00000100:00100000:0.0:1788625860.127064:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823767168 00000100:00100000:0.0:1788625860.127121:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:0.0:1788625860.127132:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11656:x1875509823767168:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625860.127166:0:6721:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625860.127273:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+26:11656:x1875509823767168:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625860.127282:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:2.0:1788625860.128062:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1875509845771648:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625860.139765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.140046:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823767424 00000100:00100000:2.0:1788625860.140057:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823767424 00000100:00100000:2.0:1788625860.140127:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:2.0:1788625860.140137:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+25:11656:x1875509823767424:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625860.140160:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625860.140181:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1465a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cef1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.140292:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.140306:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.140318:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625860.140328:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788625860.140472:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1465a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef1 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.140490:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef1 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.140499:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625860.140519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788625860.140524:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a000, rc 0) 00000100:00100000:2.0:1788625860.140588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+27:11656:x1875509823767424:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 452us (871us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788625860.140596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:3.0:1788625860.156186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.156234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625860.156388:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823767552 00000100:00100000:1.0:1788625860.156398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823767552 00000100:00100000:1.0:1788625860.156671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823767808 00000100:00100000:1.0:1788625860.156676:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823767808 00000100:00100000:2.0:1788625860.161389:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:2.0:1788625860.161420:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+28:11658:x1875509823767552:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625860.161473:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625860.161498:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1466f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cef8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161568:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161582:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161593:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161610:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161617:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.161624:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.162057:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.162077:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.162087:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.162122:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.162140:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 29 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625860.162153:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845771776:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625860.163045:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625860.163177:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:0.0:1788625860.163192:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+29:11656:x1875509823767808:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788625860.163280:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163294:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163305:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163625:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163633:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163640:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163647:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625860.163652:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163659:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163672:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625860.163675:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625860.163680:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625860.163686:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380742600/0x8aede7274cb1468b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625860.163897:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:11656:x1875509823767808:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 709us (7661us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788625860.163907:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 235 00000040:00080000:3.0:1788625860.167005:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625860.167015:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625860.167717:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788625860.167762:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625860.170951:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875509845771776:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625860.170986:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625860.171140:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.171425:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768064 00000100:00100000:3.0:1788625860.171431:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768064 00000100:00100000:3.0:1788625860.171528:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1788625860.171538:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:5603:x1875509823768064:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788625860.171776:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:5603:x1875509823768064:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 238us (635us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788625860.171783:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:0.0:1788625860.171872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.186569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768320 00000100:00100000:2.0:1788625860.186584:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768320 00000100:00100000:2.0:1788625860.186658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1788625860.186669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:11656:x1875509823768320:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625860.187117:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11656:x1875509823768320:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 449us (15244us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788625860.187126:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:1.0:1788625860.202427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625860.202631:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768448 00000100:00100000:2.0:1788625860.202641:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768448 00010000:00010000:2.0:1788625860.202680:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 32 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625860.202761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1788625860.202772:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:2366:x1875509823768448:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625860.202786:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625860.202794:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 32 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202809:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 32 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202845:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb1457a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb2 expref: 32 pid: 5843 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202861:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:2.0:1788625860.202866:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202876:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202885:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625860.202914:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625860.202973:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+31:2366:x1875509823768448:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 203us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625860.202981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00010000:00010000:3.0:1788625860.203481:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203491:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625860.203542:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788625860.203547:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625860.203568:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203582:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203591:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203598:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203605:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203611:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625860.203615:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203631:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625860.203634:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625860.203638:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203644:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb14676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203668:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203674:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203680:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203686:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94ae00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625860.203689:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203695:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203703:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b4356b43e00) 00010000:00010000:3.0:1788625860.203706:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625860.203709:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203714:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94ae00/0x8aede7274cb1467d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203783:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb1466f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef8 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203797:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef8 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625860.203818:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625860.203820:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625860.204383:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b800, rc 0) 00000100:00100000:3.0:1788625860.204430:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:11658:x1875509823767552:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 43028us (48256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625860.205073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:1.0:1788625860.260567:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625860.260609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625860.260642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625860.260719:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768704 00000100:00100000:3.0:1788625860.260749:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768704 00000100:00100000:3.0:1788625860.260830:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:3.0:1788625860.260842:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823768704:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625860.260932:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2365:x1875509823768704:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625860.260939:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:0.0:1788625860.261071:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768832 00000100:00100000:0.0:1788625860.261076:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768832 00000100:00100000:0.0:1788625860.261122:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:0.0:1788625860.261131:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823768832:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625860.261166:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2365:x1875509823768832:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625860.261173:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:2.0:1788625860.261260:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823768576 00000100:00100000:2.0:1788625860.261283:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823768576 00000100:00100000:2.0:1788625860.261331:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 304 00000100:00100000:2.0:1788625860.261339:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823768576:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625860.261368:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2365:x1875509823768576:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625860.261375:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 304 00000100:00080000:1.0:1788625860.261976:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625860.261982:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625860.852031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788625861.196459:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788625861.196481:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:0.0:1788625861.203554:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625861.203565:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625861.203632:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788625861.203640:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625861.498285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625861.509641:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769088 00000100:00100000:3.0:1788625861.509660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769088 00000100:00100000:3.0:1788625861.509763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00100000:3.0:1788625861.509776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+30:11681:x1875509823769088:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625861.509805:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625861.509828:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7ceff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625861.509926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625861.509942:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625861.509965:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625861.509979:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788625861.510110:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7a00/0x8aede7274cb14692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceff expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625861.510127:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceff expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625861.510136:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625861.510139:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788625861.510143:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7800, rc 0) 00000100:00100000:3.0:1788625861.510210:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11681:x1875509823769088:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 438us (11934us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788625861.510216:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00080000:1.0:1788625861.510384:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625861.513160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625861.513228:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769216 00000100:00100000:0.0:1788625861.513238:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769216 00000100:00100000:0.0:1788625861.513303:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:0.0:1788625861.513313:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11681:x1875509823769216:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1788625861.513378:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513396:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513425:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513470:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513478:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513486:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513492:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625861.513497:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513505:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513517:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:0.0:1788625861.513520:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625861.513525:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.513531:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743a00/0x8aede7274cb146a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625861.513616:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+32:11681:x1875509823769216:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 304us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625861.513625:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:3.0:1788625861.619568:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845772032:0@lo:400:kworker.0 00000100:00100000:3.0:1788625861.619651:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625861.619748:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845772544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625861.619779:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625861.619812:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625861.619819:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788625861.619843:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625861.619975:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845772288:0@lo:400:kworker.0 00000100:00100000:1.0:1788625861.620007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625861.620039:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625861.620045:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845771904:0@lo:400:kworker.0 00000100:00100000:1.0:1788625861.620075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625861.620105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845772416:0@lo:400:kworker.0 00000100:00100000:1.0:1788625861.620128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625861.620776:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772032 00000100:00100000:0.0:1788625861.620797:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772032 00000100:00100000:0.0:1788625861.620844:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772160 00000100:00100000:0.0:1788625861.620848:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772160 00000100:00100000:0.0:1788625861.620874:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772416 00000100:00100000:0.0:1788625861.620876:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772416 00000100:00100000:0.0:1788625861.620892:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788625861.620900:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.620966:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43656b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845772032:12345-0@lo:400:kworker.0 Request processed in 67us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625861.620974:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788625861.620992:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788625861.620999:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845772160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.621028:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845772160:12345-0@lo:400:kworker.0 Request processed in 30us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625861.621034:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788625861.621048:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788625861.621054:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845772416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.621083:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845772416:12345-0@lo:400:kworker.0 Request processed in 30us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625861.621088:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788625861.621103:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625861.621136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845772416:0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.621169:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845772160:0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.621179:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845772032:0@lo:400:kworker.0 00000100:00100000:2.0:1788625861.621312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772544 00000100:00100000:2.0:1788625861.621317:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772544 00000100:00100000:2.0:1788625861.621368:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772288 00000100:00100000:2.0:1788625861.621372:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772288 00000100:00100000:2.0:1788625861.621393:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625861.621401:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845772544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625861.621462:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845772544:12345-0@lo:400:kworker.0 Request processed in 62us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625861.621467:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625861.621481:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625861.621487:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845772288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625861.621516:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845772288:12345-0@lo:400:kworker.0 Request processed in 30us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625861.621522:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625861.621543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845771904 00000100:00100000:2.0:1788625861.621546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845771904 00000100:00100000:2.0:1788625861.621565:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788625861.621571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625861.621597:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845771904:12345-0@lo:400:kworker.0 Request processed in 27us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625861.621613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:0.0:1788625861.623678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625861.623691:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625861.623806:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845771904:0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.623827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845772288:0@lo:400:kworker.0 00000100:00100000:0.0:1788625861.623874:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788625861.623880:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b43656b3480, transno 4294967307 00000004:00080000:0.0:1788625861.623901:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788625861.623924:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b4347cdad80, transno 4294967310 00000100:00100000:0.0:1788625861.623929:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845772544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625861.643357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625861.643846:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769344 00000100:00100000:0.0:1788625861.643858:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769344 00000100:00100000:0.0:1788625861.643953:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:0.0:1788625861.643964:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823769344:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:0.0:1788625861.643983:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625861.644008:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb146ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf06 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625861.644040:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c43c3, atime: 0x6a9c43c3, ctime: 0x6a9c43c3, blocks: 0xb 00010000:00010000:0.0:1788625861.644072:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788625861.644078:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625861.644096:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb146ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf06 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.644127:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb146ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf06 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625861.644149:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743a00, rc 0) 00000100:00100000:0.0:1788625861.644273:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2364:x1875509823769344:12345-192.168.201.45@tcp:101:cat.0 Request processed in 302us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625861.644281:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00080000:1.0:1788625861.644446:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625861.656690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625861.656816:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769472 00000100:00100000:3.0:1788625861.656828:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769472 00002000:00100000:3.0:1788625861.656900:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b43435ece00 x1875509823769472/t0(0) o3->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:672/0 lens 488/0 e 0 to 0 dl 1788625872 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625861.656911:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43435ece00 with x1875509823769472 ext(0->4095) 00002000:00010000:3.0:1788625861.656916:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43435ece00 00000100:00100000:3.0:1788625861.656954:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1788625861.656963:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2363:x1875509823769472:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:3.0:1788625861.657163:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+8:2363:x1875509823769472:12345-192.168.201.45@tcp:3:cat.0 Request processed in 200us (481us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788625861.657171:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00002000:00100000:3.0:1788625861.657178:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b43435ece00 x1875509823769472/t0(0) o3->b12515be-537a-4a8b-a2d2-568b1a5329ac@192.168.201.45@tcp:672/0 lens 488/4536 e 0 to 0 dl 1788625872 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788625861.657184:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b43435ece00 with x1875509823769472 ext(0->4095) 00002000:00010000:3.0:1788625861.657188:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b43435ece00 00010000:00010000:1.0:1788625861.875095:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625862.131783:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625862.131812:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845772672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625862.131889:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625862.132180:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772672 00000100:00100000:3.0:1788625862.132190:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772672 00000100:00100000:3.0:1788625862.132241:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625862.132250:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845772672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625862.132284:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625862.132334:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845772672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625862.132340:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788625862.132429:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845772672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625862.907795:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625863.219978:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625863.219991:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625863.220062:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788625863.220076:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788625863.925165:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625864.955160:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625865.206636:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625865.206675:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845772800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625865.206818:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625865.206919:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772800 00000100:00100000:1.0:1788625865.206929:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772800 00000100:00100000:1.0:1788625865.207004:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788625865.207016:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875509845772800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625865.207062:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625865.207118:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875509845772800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625865.207125:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788625865.207149:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625865.209633:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845772800:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788625865.299270:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:3.0:1788625865.299297:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b4344ddad80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788625865.299305:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b435db77300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b43489f4480 00000020:00080000:3.0:1788625865.299308:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b435db77b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b4379923400 00000001:00080000:3.0:1788625865.299331:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1788625865.299348:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788625865.299382:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788625865.299435:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788625865.301061:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1788625865.302251:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788625865.302274:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:3.0:1788625865.384438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625865.384487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625865.384535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625865.384575:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625865.384606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625865.384649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770112 00000100:00100000:3.0:1788625865.384661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770112 00000100:00100000:2.0:1788625865.384877:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769728 00000100:00100000:2.0:1788625865.384882:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769728 00000100:00100000:2.0:1788625865.384922:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1788625865.384933:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823770112:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625865.385032:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:2364:x1875509823770112:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625865.385040:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1788625865.385059:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:2.0:1788625865.385066:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2364:x1875509823769728:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625865.385093:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2364:x1875509823769728:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625865.385099:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:3.0:1788625865.385257:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769856 00000100:00100000:3.0:1788625865.385263:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769856 00000100:00100000:3.0:1788625865.385296:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769984 00000100:00100000:3.0:1788625865.385299:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769984 00000100:00100000:3.0:1788625865.385326:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:3.0:1788625865.385333:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823769856:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625865.386502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823769600 00000100:00100000:0.0:1788625865.386517:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823769600 00000100:00100000:0.0:1788625865.386574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 306 00000100:00100000:0.0:1788625865.386584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823769600:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625865.386653:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823769600:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 71us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625865.386662:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 306 00000100:00100000:0.0:1788625865.386709:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:0.0:1788625865.386718:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823769984:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625865.390135:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823769984:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 3399us (5508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625865.390156:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00080000:2.0:1788625865.391469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625865.391482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625865.391487:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625865.403423:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823769856:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 18073us (18918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625865.403442:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00010000:00010000:3.0:1788625865.974176:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625866.739269:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845773312:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739382:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739489:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788625866.739495:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845772928:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845773440:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739588:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739623:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845773056:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739651:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739670:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845773568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739692:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739710:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625866.739715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845773184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.739763:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625866.739804:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773312 00000100:00100000:2.0:1788625866.739814:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773312 00000100:00100000:2.0:1788625866.739886:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773568 00000100:00100000:2.0:1788625866.739890:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773568 00000100:00100000:2.0:1788625866.739928:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625866.739938:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845773312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740000:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845773312:12345-0@lo:400:kworker.0 Request processed in 64us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740008:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625866.740029:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625866.740036:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845773568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740068:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845773568:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740075:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625866.740104:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845772928 00000100:00100000:2.0:1788625866.740109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845772928 00000100:00100000:2.0:1788625866.740140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788625866.740148:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845772928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740181:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845772928:12345-0@lo:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740188:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788625866.740220:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773440 00000100:00100000:2.0:1788625866.740224:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773440 00000100:00100000:2.0:1788625866.740252:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773056 00000100:00100000:2.0:1788625866.740255:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773056 00000100:00100000:2.0:1788625866.740266:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773184 00000100:00100000:2.0:1788625866.740269:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773184 00000100:00100000:2.0:1788625866.740283:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788625866.740289:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845773440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740317:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845773440:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740323:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788625866.740332:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788625866.740350:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845773056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740375:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845773056:12345-0@lo:400:kworker.0 Request processed in 39us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740381:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788625866.740391:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788625866.740396:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845773184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740418:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845773184:12345-0@lo:400:kworker.0 Request processed in 22us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.740435:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788625866.740466:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625866.740471:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625866.740546:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845773184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740560:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845773056:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740570:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845773568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740605:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845772928:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740615:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845773440:0@lo:400:kworker.0 00000100:00100000:2.0:1788625866.740624:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788625866.740629:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b437f905f80, transno 4294967322 00000004:00080000:2.0:1788625866.740641:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788625866.740668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845773312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625866.915413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625866.922889:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770240 00000100:00100000:2.0:1788625866.922912:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770240 00000100:00100000:2.0:1788625866.923005:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:2.0:1788625866.923018:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11342:x1875509823770240:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788625866.923175:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11342:x1875509823770240:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 158us (7777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625866.923184:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:1.0:1788625866.928116:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625866.928269:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770496 00000100:00100000:3.0:1788625866.928284:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770496 00000100:00100000:3.0:1788625866.928445:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:3.0:1788625866.928469:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:11342:x1875509823770496:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788625866.929328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:11342:x1875509823770496:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 857us (1220us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788625866.929350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00010000:00010000:1.0:1788625866.995271:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625867.251306:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625867.251350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845773696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625867.251457:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625867.251960:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773696 00000100:00100000:1.0:1788625867.251973:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773696 00000100:00100000:1.0:1788625867.252045:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788625867.252059:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845773696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625867.252114:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625867.252192:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845773696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625867.252216:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625867.252461:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845773696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625867.380108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625867.380380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770624 00000100:00100000:2.0:1788625867.380396:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770624 00000100:00100000:2.0:1788625867.380500:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 239 00000100:00100000:2.0:1788625867.380513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+5:12132:x1875509823770624:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:2.0:1788625867.380556:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625867.380587:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb146b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380675:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380694:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380711:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625867.380798:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788625867.380803:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788625867.380837:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380868:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a600/0x8aede7274cb146b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf0d expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380897:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf0d expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625867.380907:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:2.0:1788625867.380911:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625867.380915:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b400, rc 0) 00000100:00080000:3.0:1788625867.381054:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625867.381991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:12132:x1875509823770624:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 1472us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625867.382003:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 239 00010000:00010000:0.0:1788625868.018968:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625869.043206:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625870.066958:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625870.331655:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845773824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625870.331791:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625870.331912:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773824 00000100:00100000:2.0:1788625870.331923:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773824 00000100:00100000:2.0:1788625870.333186:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625870.333210:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845773824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625870.333266:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625870.333377:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845773824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625870.333386:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625870.333463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845773824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788625870.333602:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788625870.399861:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788625870.399877:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788625870.399964:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788625870.399973:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788625870.487331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625870.487435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625870.487471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625870.487507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625870.487529:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771264 00000100:00100000:3.0:1788625870.487544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625870.487547:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771264 00000100:00100000:3.0:1788625870.487577:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771008 00000100:00100000:3.0:1788625870.487588:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771008 00000100:00100000:2.0:1788625870.487655:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770880 00000100:00100000:3.0:1788625870.487658:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771136 00000100:00100000:2.0:1788625870.487661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770880 00000100:00100000:3.0:1788625870.487666:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771136 00000100:00100000:3.0:1788625870.487721:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:2.0:1788625870.487722:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:3.0:1788625870.487779:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823771008:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625870.487790:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2363:x1875509823771264:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625870.487910:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2363:x1875509823771264:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 127us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625870.487918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:2.0:1788625870.487943:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:2.0:1788625870.487949:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2363:x1875509823770880:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625870.488559:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823770752 00000100:00100000:0.0:1788625870.488567:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823770752 00000100:00100000:0.0:1788625870.488611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 308 00000100:00100000:0.0:1788625870.488639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823770752:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625870.488713:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4377f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2363:x1875509823771008:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 939us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625870.488721:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:3.0:1788625870.488755:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:3.0:1788625870.488762:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823771136:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625870.488806:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2363:x1875509823771136:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625870.488813:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00080000:3.0:1788625870.488841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625870.488846:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625870.488848:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625870.495597:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2363:x1875509823770880:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 7625us (8071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625870.495607:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2363:x1875509823770752:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 6952us (8270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625870.495630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:0.0:1788625870.495632:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 308 00010000:00010000:0.0:1788625871.092299:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625871.117542:0:12728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:31:09 (1788625869) 00000100:00100000:1.0:1788625871.859179:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845773952:0@lo:400:kworker.0 00000100:00100000:1.0:1788625871.859295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625871.860175:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788625871.860233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625871.860406:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774080 00000100:00100000:3.0:1788625871.860418:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774080 00000100:00100000:3.0:1788625871.860498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788625871.860510:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845774080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625871.860580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845774080:12345-0@lo:400:kworker.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625871.860588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788625871.860640:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788625871.866865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845773952 00000100:00100000:0.0:1788625871.866886:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845773952 00000100:00100000:0.0:1788625871.866973:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788625871.866986:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845773952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625871.867105:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845773952:12345-0@lo:400:kworker.0 Request processed in 122us (7810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625871.867113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788625871.867589:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845773952:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.877464:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845774208:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.877563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625871.877619:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625871.877626:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845774592:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.877656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625871.877689:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845774464:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.877716:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625871.877833:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845774336:0@lo:400:kworker.0 00000100:00100000:1.0:1788625871.877871:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625871.877922:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774592 00000100:00100000:1.0:1788625871.877932:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774592 00000100:00100000:1.0:1788625871.877998:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774336 00000100:00100000:1.0:1788625871.878002:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774336 00000100:00100000:1.0:1788625871.878026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788625871.878035:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845774592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625871.878111:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845774592:12345-0@lo:400:kworker.0 Request processed in 77us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625871.878119:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788625871.878139:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788625871.878146:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845774336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625871.878179:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845774336:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625871.878185:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788625871.878203:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625871.878245:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845774336:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.878863:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774208 00000100:00100000:2.0:1788625871.878871:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774208 00000100:00100000:2.0:1788625871.878916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774464 00000100:00100000:2.0:1788625871.878920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774464 00000100:00100000:2.0:1788625871.878943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788625871.878950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845774208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.878999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845774208:12345-0@lo:400:kworker.0 Request processed in 49us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625871.879006:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788625871.879021:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788625871.879026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845774464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.880947:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845774464:12345-0@lo:400:kworker.0 Request processed in 1907us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625871.880965:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788625871.881153:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845774592:0@lo:400:kworker.0 00000100:00100000:2.0:1788625871.881174:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845774208:0@lo:400:kworker.0 00000100:00080000:1.0:1788625871.881863:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625871.889386:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845774464:0@lo:400:kworker.0 00010000:00010000:3.0:1788625872.115971:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625872.378450:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845774720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625872.378540:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625872.378632:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774720 00000100:00100000:0.0:1788625872.378643:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774720 00000100:00100000:0.0:1788625872.378702:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788625872.378714:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845774720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625872.378780:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625872.378833:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4343590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845774720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625872.378841:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788625872.378908:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845774720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625873.146034:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625873.462273:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625873.462288:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625873.462890:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788625873.462900:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788625874.162914:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625875.189579:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625875.443118:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625875.443150:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845774848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625875.443241:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625875.445016:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774848 00000100:00100000:2.0:1788625875.445029:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774848 00000100:00100000:2.0:1788625875.445098:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625875.445129:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845774848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625875.445174:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625875.445260:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845774848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625875.445269:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788625875.445857:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625875.446035:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845774848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625875.608050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625875.608336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625875.608365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625875.608395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.608519:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771648 00000100:00100000:1.0:1788625875.608531:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771648 00000100:00100000:1.0:1788625875.608591:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:1.0:1788625875.608599:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823771648:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625875.608668:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2364:x1875509823771648:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 70us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.608675:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00080000:1.0:1788625875.608705:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625875.608773:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771904 00000100:00100000:1.0:1788625875.608777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771904 00000100:00100000:1.0:1788625875.608804:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771520 00000100:00100000:1.0:1788625875.608807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771520 00000100:00100000:1.0:1788625875.608825:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:1.0:1788625875.608831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2364:x1875509823771904:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625875.608858:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2364:x1875509823771904:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.608864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:1.0:1788625875.608877:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:1.0:1788625875.608882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2364:x1875509823771520:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625875.608901:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:2364:x1875509823771520:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 19us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.608907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00080000:1.0:1788625875.608940:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625875.609624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771392 00000100:00100000:0.0:1788625875.609631:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771392 00000100:00100000:0.0:1788625875.609677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 310 00000100:00100000:0.0:1788625875.609686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823771392:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625875.609760:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2364:x1875509823771392:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 75us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625875.609768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 310 00000100:00100000:2.0:1788625875.610611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.610714:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823771776 00000100:00100000:1.0:1788625875.610721:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823771776 00000100:00100000:1.0:1788625875.610809:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:1.0:1788625875.610835:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823771776:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625875.610889:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2364:x1875509823771776:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 55us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.610896:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00080000:2.0:1788625875.612392:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625875.764162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.764256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823772160 00000100:00100000:1.0:1788625875.764266:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823772160 00000100:00100000:1.0:1788625875.764335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:1.0:1788625875.764348:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+19:12355:x1875509823772160:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:1.0:1788625875.764780:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:12355:x1875509823772160:12345-192.168.201.45@tcp:35:umount.0 Request processed in 433us (627us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788625875.764787:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1788625875.772788:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625875.775053:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823772416 00000100:00100000:3.0:1788625875.775069:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823772416 00000100:00100000:3.0:1788625875.775162:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:3.0:1788625875.775173:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+20:12355:x1875509823772416:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:3.0:1788625875.775965:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:12355:x1875509823772416:12345-192.168.201.45@tcp:35:umount.0 Request processed in 790us (3184us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788625875.775973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1788625875.780177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.780588:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823772672 00000100:00100000:1.0:1788625875.780600:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823772672 00000100:00100000:1.0:1788625875.780760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:1.0:1788625875.780772:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434351fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+21:12355:x1875509823772672:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:1.0:1788625875.782596:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434351fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:12355:x1875509823772672:12345-192.168.201.45@tcp:35:umount.0 Request processed in 1818us (2422us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788625875.782620:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:0.0:1788625875.799353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625875.799430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823772928 00000100:00100000:3.0:1788625875.799441:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823772928 00000100:00100000:3.0:1788625875.799543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:3.0:1788625875.799557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+22:12355:x1875509823772928:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:3.0:1788625875.799930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:12355:x1875509823772928:12345-192.168.201.45@tcp:35:umount.0 Request processed in 376us (656us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788625875.799935:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:0.0:1788625875.808195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625875.808238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625875.808323:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823773056 00000100:00100000:0.0:1788625875.808337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625875.808345:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823773056 00000100:00100000:3.0:1788625875.808408:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823773312 00000100:00100000:3.0:1788625875.808412:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823773312 00000100:00100000:3.0:1788625875.808427:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823773184 00000100:00100000:3.0:1788625875.808430:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823773184 00000100:00100000:1.0:1788625875.808438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1788625875.808449:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435722ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+15:2366:x1875509823773056:12345-192.168.201.45@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788625875.808458:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00010000:00010000:1.0:1788625875.808466:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788625875.808470:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+15:2366:x1875509823773312:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625875.808478:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625875.808486:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016e00/0x8aede7274cb13734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca98 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625875.808505:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625875.808586:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435722ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+14:2366:x1875509823773056:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 138us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.808593:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1788625875.808657:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:1.0:1788625875.808664:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+13:2366:x1875509823773184:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625875.808672:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625875.808680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031c00/0x8aede7274cb1369a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca60 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625875.808692:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625875.808709:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e14f167-db63-45ad-afc4-5c2146b520f9+12:2366:x1875509823773184:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.808715:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00010000:00010000:3.0:1788625875.808990:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798daa00/0x8aede7274cb13948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb63 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.809002:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625875.810907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.811337:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823773440 00000100:00100000:1.0:1788625875.811349:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823773440 00000100:00100000:1.0:1788625875.811409:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:1.0:1788625875.811419:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2362:x1875509823773440:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:1.0:1788625875.811574:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13a0c 00000100:00080000:1.0:1788625875.811585:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b4348a30800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625875.811858:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788625875.812439:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625875.812488:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b12515be-537a-4a8b-a2d2-568b1a5329ac+2:2362:x1875509823773440:12345-192.168.201.45@tcp:9:umount.0 Request processed in 1068us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.812497:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:0.0:1788625875.817953:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2366:x1875509823773312:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 9475us (9701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625875.817970:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625875.824121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.824209:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823773824 00000100:00100000:1.0:1788625875.824221:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823773824 00000100:00100000:1.0:1788625875.824297:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1788625875.824308:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2362:x1875509823773824:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:1.0:1788625875.824356:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13c74 00000020:00010000:1.0:1788625875.824365:0:6696:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b4348a37000: total 0 00000100:00080000:1.0:1788625875.824370:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b4348a32000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625875.824407:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788625875.824706:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b12515be-537a-4a8b-a2d2-568b1a5329ac+5:2362:x1875509823773824:12345-192.168.201.45@tcp:9:umount.0 Request processed in 398us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625875.824715:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000020:00010000:0.0:1788625875.825991:0:6712:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b4348a37000: total 0 00010000:00010000:0.0:1788625875.826037:0:6712:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b4348a37000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788625875.826089:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb146ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf06 expref: 4 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625875.826139:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90da4bd/0x8aede7274cb14010 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd38 expref: 3 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625875.826151:0:6712:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b4348a37000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788625875.826160:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625875.826162:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625875.826163:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625875.837966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625875.838266:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823774848 00000100:00100000:1.0:1788625875.838277:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823774848 00000100:00100000:1.0:1788625875.838342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 240 00000100:00100000:1.0:1788625875.838353:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+23:2362:x1875509823774848:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:1.0:1788625875.838390:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb136a8 00000020:00010000:1.0:1788625875.838408:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b4379eec800: total 0 00000100:00080000:1.0:1788625875.838524:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9b4379ee8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625875.838555:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788625875.839775:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b4379eec800: total 0 00010000:00010000:3.0:1788625875.839836:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b4379eec800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1788625875.839865:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625875.839869:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788625875.839878:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743000/0x8aede7274cb1408e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd5b expref: 22 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.839898:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625875.839900:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625875.839904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94aa00/0x8aede7274cb13ef1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cceb expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.839920:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625875.839922:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788625875.839926:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ca00/0x8aede7274cb139e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb8d expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.839938:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625875.839940:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625875.839943:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4380743400/0x8aede7274cb1458f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceb9 expref: 19 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.839954:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625875.839957:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625875.839961:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b800/0x8aede7274cb14684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.839974:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b435917b100) 00010000:00010000:3.0:1788625875.839976:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625875.839999:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dac00/0x8aede7274cb1398e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb78 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840034:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625875.840037:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788625875.840041:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798dae00/0x8aede7274cb13ffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd31 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840051:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625875.840053:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788625875.840057:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cef1 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840068:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:3.0:1788625875.840070:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625875.840074:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798db400/0x8aede7274cb14072 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd54 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840086:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b435917bb00) 00010000:00010000:3.0:1788625875.840089:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788625875.840093:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f7800/0x8aede7274cb14699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ceff expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840107:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b4356b43200) 00010000:00010000:3.0:1788625875.840110:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625875.840113:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6400/0x8aede7274cb13fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cd23 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840128:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b435917b900) 00010000:00010000:3.0:1788625875.840136:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625875.840141:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6000/0x8aede7274cb1436d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ce2d expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840160:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b4348a9f200) 00010000:00010000:3.0:1788625875.840163:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625875.840167:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43798da800/0x8aede7274cb13ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cc5f expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840192:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039300) 00010000:00010000:3.0:1788625875.840194:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625875.840197:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43821f6800/0x8aede7274cb13972 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb71 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625875.840209:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b4379eec800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1788625875.840221:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625875.840224:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625875.840226:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625875.840403:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b12515be-537a-4a8b-a2d2-568b1a5329ac+7:2362:x1875509823774848:12345-192.168.201.45@tcp:39:umount.0 Request processed in 2050us (2448us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788625875.840429:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 240 00010000:00010000:2.0:1788625876.211886:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788625876.521758:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:0.0:1788625876.521825:0:7653:0:(genops.c:885:class_export_put()) final put ffff9b4348a31800/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:2.0:1788625876.521888:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4348a31800/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-OST0001 00000020:00000080:2.0:1788625876.522257:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4348a30800 for lustre-OST0001 00000100:00100000:1.0:1788625876.979171:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625876.979329:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625876.979351:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845775360:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.979446:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625876.979521:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775360 00000100:00100000:3.0:1788625876.979529:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775360 00000100:00100000:3.0:1788625876.979603:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788625876.979623:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845775360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.979675:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845775360:12345-0@lo:400:kworker.0 Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625876.979682:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788625876.979761:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845775360:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.979814:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4347cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845775232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.979844:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625876.979877:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625876.979884:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43656b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.979906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625876.979932:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775232 00000100:00100000:3.0:1788625876.979935:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775232 00000100:00100000:3.0:1788625876.979971:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775104 00000100:00100000:3.0:1788625876.979974:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775104 00000100:00100000:3.0:1788625876.979994:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788625876.980001:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845775232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.980037:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845775232:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625876.980043:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788625876.980056:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788625876.980062:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845775104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.980087:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845775104:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625876.980093:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788625876.980127:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43656b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.980137:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4347cdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845775232:0@lo:400:kworker.0 00000100:00080000:3.0:1788625876.980176:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625876.984604:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845774976:0@lo:400:kworker.0 00000100:00100000:1.0:1788625876.984923:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625876.985210:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845775616:0@lo:400:kworker.0 00000100:00100000:2.0:1788625876.985256:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625876.986173:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775616 00000100:00100000:1.0:1788625876.986184:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775616 00000100:00100000:1.0:1788625876.986261:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788625876.986271:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845775616:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788625876.989629:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625876.989677:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845775488:0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.989810:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625876.990407:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775488 00000100:00100000:2.0:1788625876.990417:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775488 00000100:00100000:2.0:1788625876.990491:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788625876.990501:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845775488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625876.990571:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845775488:12345-0@lo:400:kworker.0 Request processed in 71us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625876.990578:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788625876.990634:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845775488:0@lo:400:kworker.0 00000100:00080000:3.0:1788625876.991031:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625876.992102:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845774976 00000100:00100000:0.0:1788625876.992115:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845774976 00000100:00100000:0.0:1788625876.992189:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788625876.992199:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625876.992445:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845774976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625876.993012:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845774976:12345-0@lo:400:kworker.0 Request processed in 88us (7363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625876.993021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788625876.994002:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845775616:12345-0@lo:400:kworker.0 Request processed in 7728us (8741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625876.994029:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625876.994114:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845775616:0@lo:400:kworker.0 00010000:00010000:0.0:1788625877.234938:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625877.491580:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625877.491603:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845775744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625877.491675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625877.491818:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775744 00000100:00100000:0.0:1788625877.491826:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775744 00000100:00100000:0.0:1788625877.491883:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788625877.491896:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845775744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625877.491932:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625877.491977:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845775744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625877.491983:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625877.493295:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845775744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625877.967862:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625877.967931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625877.967998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625877.968321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823774976 00000100:00100000:2.0:1788625877.968332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823774976 00000100:00100000:2.0:1788625877.968405:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823775232 00000100:00100000:2.0:1788625877.968409:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823775232 00000100:00100000:2.0:1788625877.968432:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823775104 00000100:00100000:2.0:1788625877.968435:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823775104 00000100:00100000:2.0:1788625877.968454:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1788625877.968463:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+12:2363:x1875509823774976:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625877.968479:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625877.968498:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798db200/0x8aede7274cb1377a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7caad expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625877.968516:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625877.968570:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+11:2363:x1875509823774976:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 108us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625877.968577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1788625877.968594:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1788625877.968600:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+10:2363:x1875509823775232:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625877.968607:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625877.968617:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031400/0x8aede7274cb13941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cb5c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625877.968628:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625877.968644:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+9:2363:x1875509823775232:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 46us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625877.968650:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1788625877.968676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1788625877.968683:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+8:2363:x1875509823775104:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625877.968690:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625877.968698:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2200/0x8aede7274cb13781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cad7 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625877.968708:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625877.968723:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e14f167-db63-45ad-afc4-5c2146b520f9+7:2363:x1875509823775104:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 41us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625877.968796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1788625877.976089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625877.976258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823775488 00000100:00100000:3.0:1788625877.976272:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823775488 00000100:00100000:3.0:1788625877.976392:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 241 00000100:00100000:3.0:1788625877.976409:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+6:2362:x1875509823775488:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:3.0:1788625877.976467:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1378f 00000020:00010000:3.0:1788625877.976478:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b4347c01800: total 0 00000100:00080000:3.0:1788625877.976484:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9b4347c01000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625877.976516:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788625877.976555:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b4347c01800: total 0 00010000:00010000:1.0:1788625877.976567:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625877.976629:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b4347c01800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788625877.976673:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b435917b200) 00010000:00010000:1.0:1788625877.976678:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625877.976690:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b400/0x8aede7274cb146bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf0d expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625877.976722:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b4347c01800, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1788625877.976866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c41c9396-b2e6-4afd-9ccb-15f885c15f82+4:2362:x1875509823775488:12345-192.168.201.45@tcp:39:umount.0 Request processed in 461us (792us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788625877.976876:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 241 00010000:00010000:1.0:1788625877.976998:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625877.977002:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625877.977004:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625877.977125:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625877.992103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625877.997377:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823775744 00000100:00100000:1.0:1788625877.997404:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823775744 00000100:00100000:1.0:1788625877.997506:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 312 00000100:00100000:1.0:1788625877.997520:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+7:2362:x1875509823775744:12345-192.168.201.45@tcp:251:umount.0 00000020:00000080:1.0:1788625877.997584:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13685 00000020:00010000:1.0:1788625877.997593:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b4241b59800: total 0 00000100:00080000:1.0:1788625877.997599:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9b4241b5f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788625877.997753:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e14f167-db63-45ad-afc4-5c2146b520f9+3:2362:x1875509823775744:12345-192.168.201.45@tcp:251:umount.0 Request processed in 234us (5663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625877.997762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 312 00000020:00010000:2.0:1788625877.997994:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b4241b59800: total 0 00010000:00010000:2.0:1788625877.998072:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b4241b59800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788625877.998114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1373b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7ca9f expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625877.998133:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b4241b59800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788625877.998407:0:5831:0:(genops.c:885:class_export_put()) final put ffff9b4241b59800/7e14f167-db63-45ad-afc4-5c2146b520f9 00010000:00010000:2.0:1788625877.998474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625877.998477:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625877.998479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788625877.998548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4241b59800/7e14f167-db63-45ad-afc4-5c2146b520f9 for MGS 00000020:00000080:1.0:1788625877.998678:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4241b5f000 for MGS 00010000:00010000:0.0:1788625878.260098:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625879.283014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625880.148635:0:12926:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788625880.171027:0:12926:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788625880.171080:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.171097:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.171132:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.171140:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.171166:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625880.171172:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788625880.171196:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625880.171200:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788625880.171207:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788625880.171305:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625880.171314:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171321:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798db000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625880.171324:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171333:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625880.171340:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625880.171356:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625880.171359:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788625880.171361:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788625880.171401:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171407:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625880.171429:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171435:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43798db000/0x8aede7274cb1370a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13711 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171448:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625880.171449:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625880.171451:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625880.171468:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845775872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625880.171545:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625880.171622:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845775872 00000100:00100000:3.0:1788625880.171630:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845775872 00000100:00100000:3.0:1788625880.171679:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625880.171688:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3308:x1875509845775872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625880.171701:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625880.171718:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2600/0x8aede7274cb13711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb1370a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.171755:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625880.171790:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4347cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3308:x1875509845775872:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625880.171804:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625880.171848:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845775872:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788625880.172336:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b4350f99800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788625880.172566:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845776000:0@lo:39:umount.0 00000100:00100000:0.0:1788625880.172609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.172655:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776000 00000100:00100000:0.0:1788625880.172660:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776000 00000100:00100000:0.0:1788625880.172693:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788625880.172701:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875509845776000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788625880.172722:0:6721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13494 00000100:00080000:0.0:1788625880.172749:0:6721:0:(import.c:65:import_set_state_nolock()) ffff9b434fcd8800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788625880.172804:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875509845776000:12345-0@lo:39:umount.0 Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625880.172811:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788625880.172819:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b434fcdd800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788625880.172847:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625880.172866:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4350f99800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788625880.172874:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845776000:0@lo:39:umount.0 00000020:00000080:0.0:1788625880.172892:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcdd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788625880.172960:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b434fcd8800 for lustre-MDT0000 00000100:00080000:3.0:1788625880.176795:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625880.176805:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625880.176813:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788625880.179613:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179636:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179643:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179650:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179675:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625880.179681:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179710:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179716:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179721:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179751:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625880.179758:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179765:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179772:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179777:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179788:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788625880.179793:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179799:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179814:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179820:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625880.179828:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788625880.179831:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788625880.179860:0:12926:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788625880.179864:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788625880.179868:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625880.179874:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788625880.179882:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b434f8c4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625880.179887:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b437fc56800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625880.179894:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b4347c01800 c41c9396-b2e6-4afd-9ccb-15f885c15f82 192.168.201.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625880.179898:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b4379eec800 b12515be-537a-4a8b-a2d2-568b1a5329ac 192.168.201.45@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1788625880.179903:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b4350f90000) has exports, disconnecting them 00000020:00080000:2.0:1788625880.179908:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b434f8c4000), last request at 1788625876 00000020:00000080:2.0:1788625880.179915:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13607 00000100:00080000:2.0:1788625880.179938:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b434f8c3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788625880.179985:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b434f8c4000): rc 0 00000020:00000080:2.0:1788625880.179988:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434f8c4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788625880.180003:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b437fc56800), last request at 1788625876 00000020:00000080:2.0:1788625880.180006:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1353c 00000100:00080000:2.0:1788625880.180012:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b437fc54800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788625880.180019:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b437fc56800): rc 0 00000020:00000080:2.0:1788625880.180027:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b437fc56800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788625880.180034:0:12926:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdd8c1bc7ae0 00000100:00080000:2.0:1788625880.180054:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788625880.180057:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788625880.180070:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788625880.180152:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788625880.180176:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b43795a2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788625880.180191:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625880.180193:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788625880.180201:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788625880.180214:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788625880.180222:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180230:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dbc00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625880.180233:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180242:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625880.180257:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625880.180263:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788625880.180265:0:6712:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788625880.180267:0:6712:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788625880.180295:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180301:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625880.180322:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180328:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43798dbc00/0x8aede7274cb13718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1371f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788625880.180373:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434f8c4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625880.180415:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fc56800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625880.180441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b434f8c3800 for lustre-MDT0000 00000020:00000080:1.0:1788625880.180446:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b437fc54800 for lustre-MDT0000 00010000:00010000:0.0:1788625880.180918:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625880.180933:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180941:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371016400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625880.180944:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.180952:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625880.180958:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625880.180975:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788625880.180978:0:6712:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788625880.180980:0:6712:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788625880.180997:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181002:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625880.181026:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625880.181032:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845776384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625880.181033:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371016400/0x8aede7274cb1363f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13646 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181046:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625880.181049:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181054:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340031800 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625880.181057:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181072:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625880.181112:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625880.181179:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776384 00000100:00100000:1.0:1788625880.181188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776384 10000000:00010000:0.0:1788625880.181269:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625880.181274:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788625880.181277:0:6712:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788625880.181280:0:6712:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788625880.181301:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181307:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625880.181311:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625880.181316:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181317:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181323:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340031800/0x8aede7274cb13933 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1393a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181324:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3e00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625880.181327:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181334:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181334:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625880.181335:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788625880.181340:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625880.181346:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625880.181348:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788625880.181350:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788625880.181365:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181371:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625880.181377:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181394:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3e00/0x8aede7274cb133f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb133fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625880.181408:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625880.181410:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625880.181411:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625880.181418:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625880.181570:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625880.181584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845776256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625880.181616:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.181648:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625880.181654:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845776640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625880.181674:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.181700:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845776512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625880.181718:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.181769:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776256 00000100:00100000:0.0:1788625880.181773:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776256 00000100:00100000:0.0:1788625880.181801:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776640 00000100:00100000:0.0:1788625880.181803:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776640 00000100:00100000:0.0:1788625880.181813:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776512 00000100:00100000:0.0:1788625880.181815:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776512 00000100:00100000:0.0:1788625880.181829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625880.181837:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+21:3309:x1875509845776256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625880.181849:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625880.181869:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016a00/0x8aede7274cb1371f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb13718 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181881:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625880.181934:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+20:3309:x1875509845776256:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625880.181941:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625880.181957:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625880.181962:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+19:3309:x1875509845776640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625880.181969:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625880.181977:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371017400/0x8aede7274cb133fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb133f3 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.181987:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625880.182006:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+18:3309:x1875509845776640:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625880.182013:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625880.182025:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625880.182030:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+17:3311:x1875509845776512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625880.182038:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625880.182046:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340030e00/0x8aede7274cb1393a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb13933 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625880.182055:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788625880.182284:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788625880.182300:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b4378fb2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788625880.182338:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b4350f90000) has no exports 00000100:00100000:0.0:1788625880.182457:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+16:3311:x1875509845776512:12345-0@lo:103:ldlm_bl.0 Request processed in 426us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625880.182464:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625880.182489:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845776128:0@lo:9:umount.0 00000100:00100000:0.0:1788625880.182526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.182548:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845776768:0@lo:9:umount.0 00000100:00100000:0.0:1788625880.182568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625880.182603:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776128 00000100:00100000:0.0:1788625880.182608:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776128 00000100:00100000:0.0:1788625880.182649:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776768 00000100:00100000:0.0:1788625880.182652:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776768 00000100:00100000:0.0:1788625880.182674:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625880.182680:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4350f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875509845776128:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788625880.182704:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13589 00000100:00080000:0.0:1788625880.182711:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9b437fca7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625880.182767:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788625880.183045:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625880.183054:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b435722b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+15:3310:x1875509845776384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625880.183063:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625880.183074:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371017a00/0x8aede7274cb13646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb1363f expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625880.183087:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625880.183252:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845776512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625880.183449:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b435722b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3310:x1875509845776384:12345-0@lo:103:ldlm_bl.0 Request processed in 396us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625880.183457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625880.183529:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3310:1875509845776384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625880.183639:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788625880.183648:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875509845776768:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788625880.183864:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13670 00000100:00080000:1.0:1788625880.183938:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b4378fb2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625880.183971:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788625880.184312:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625880.184907:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3307:x1875509845776768:12345-0@lo:9:umount.0 Request processed in 1257us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625880.184916:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788625880.185315:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4350f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3307:x1875509845776128:12345-0@lo:9:umount.0 Request processed in 2634us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625880.185322:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788625880.185361:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625880.185365:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625880.185400:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845776640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625880.185410:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3309:1875509845776256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625880.185434:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788625880.188828:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4378fb2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788625880.188857:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788625880.188859:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625880.188867:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845776768:0@lo:9:umount.0 00000100:00080000:3.0:1788625880.188902:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b43795a2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788625880.188921:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788625880.188923:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625880.188926:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845776128:0@lo:9:umount.0 00000020:00080000:0.0:1788625880.210717:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b4350f90000) has no exports 00000020:00000080:0.0:1788625880.258065:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1344e 00000020:00000080:0.0:1788625880.258086:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43795bd000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788625880.258166:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788625880.258340:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625880.258353:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788625880.258358:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b43516f8000) has no exports 00000020:00000080:1.0:1788625880.258717:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13447 00000020:00000080:1.0:1788625880.258723:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43795a7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625880.259219:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43795bd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788625880.259380:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43795a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788625880.259427:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625880.259436:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788625880.259439:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43795a0800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788625880.259442:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43795a0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788625880.259446:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788625880.307051:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788625880.610767:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000001:00080000:1.0:1788625880.610783:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788625880.610796:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000001:00080000:1.0:1788625880.610802:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788625880.610805:0:5864:0:(genops.c:885:class_export_put()) final put ffff9b4347c01800/c41c9396-b2e6-4afd-9ccb-15f885c15f82 00000020:00000080:1.0:1788625880.610821:0:5864:0:(genops.c:885:class_export_put()) final put ffff9b4379eec800/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:3.0:1788625880.610928:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4347c01800/c41c9396-b2e6-4afd-9ccb-15f885c15f82 for lustre-MDT0000 00000020:00000080:3.0:1788625880.610986:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4379eec800/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-MDT0000 00000020:00000080:3.0:1788625880.611015:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4347c01000 for lustre-MDT0000 00000020:00000080:3.0:1788625880.611020:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4379ee8800 for lustre-MDT0000 00000001:00100000:2.0:1788625880.622885:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625880.622892:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b437fca3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625880.623076:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fca3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788625880.623279:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b437fca7800 for lustre-OST0000 00000001:00100000:2.0:1788625880.623314:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:2.0:1788625880.623318:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b4348a37000/b12515be-537a-4a8b-a2d2-568b1a5329ac 00000020:00000080:0.0:1788625880.623360:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4348a37000/b12515be-537a-4a8b-a2d2-568b1a5329ac for lustre-OST0000 00000020:00000080:0.0:1788625880.623404:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4348a32000 for lustre-OST0000 00010000:00010000:3.0:1788625881.331012:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788625881.655912:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625881.655920:0:7653:0:(genops.c:885:class_export_put()) final put ffff9b4378fb0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788625881.656036:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4378fb0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788625881.656101:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4378fb2800 for lustre-OST0001 00000100:00100000:0.0:1788625882.102378:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845777152:0@lo:400:kworker.0 00000100:00100000:0.0:1788625882.102492:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625882.102567:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625882.102574:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845777024:0@lo:400:kworker.0 00000100:00100000:0.0:1788625882.102598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625882.102637:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777152 00000100:00100000:0.0:1788625882.102644:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777152 00000100:00100000:0.0:1788625882.102679:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788625882.102687:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875509845777152:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788625882.102694:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788625882.102761:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875509845777152:12345-0@lo:400:kworker.0 Request processed in 72us (268us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788625882.102768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788625882.102979:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625882.102991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788625882.103028:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625882.103066:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845776896 00000100:00100000:3.0:1788625882.103081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845776896 00000100:00100000:3.0:1788625882.103126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788625882.103133:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3308:x1875509845776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625882.103172:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434653e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c+14:3308:x1875509845776896:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625882.103179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788625882.103227:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788625882.103273:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777024 00000100:00100000:3.0:1788625882.103277:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777024 00000100:00100000:3.0:1788625882.103296:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788625882.103301:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875509845777024:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788625882.103306:0:6721:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788625882.103330:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875509845777024:12345-0@lo:400:kworker.0 Request processed in 28us (731us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625882.103336:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788625882.103374:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788625882.103378:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b437fca3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625882.103383:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788625882.136955:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b437fca3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625882.136971:0:3311:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1788625882.136980:0:3311:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b437fca3800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625882.137031:0:3311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43435ef100 x1875509845777280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625882.137080:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845777024:0@lo:400:kworker.0 00000100:00080000:3.0:1788625882.137113:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788625882.137140:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625882.137143:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788625882.137147:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625882.137150:0:3311:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 231 00000100:00080000:3.0:1788625882.137155:0:3311:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b4379795000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625882.137170:0:3311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c8e00 x1875509845777408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625882.137181:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845777152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625882.137767:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845777280:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788625882.137837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625882.137889:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845777408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788625882.137924:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625882.137973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777280 00000100:00100000:2.0:1788625882.137980:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777280 00000100:00100000:2.0:1788625882.138014:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777408 00000100:00100000:2.0:1788625882.138017:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777408 00000100:00100000:2.0:1788625882.138034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788625882.138041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875509845777280:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788625882.138057:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788625882.138389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788625882.138395:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845777408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788625882.138404:0:5841:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788625882.138450:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845777408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 53us (525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625882.138457:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788625882.138493:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625882.138498:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625882.138501:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845777408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788625882.152305:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875509845777280:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 14253us (14458us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625882.152321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788625882.153081:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b437fca3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625882.153089:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625882.153094:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845777280:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1788625882.290932:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b437fc89ae0 - data ffff9b437fe626c0/ffff9b437f9fb400 00000020:01000000:2.0:1788625882.291100:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b434545eb40 - data ffff9b436ec2a1b0/ffff9b43795d1400 00000001:00000004:2.0:1788625882.317214:0:12926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1788625882.354960:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625882.406881:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625882.406890:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788625882.406922:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625882.406925:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788625882.407755:0:6883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788625882.407761:0:6883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788625882.407771:0:6883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788625882.411591:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625882.411599:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788625882.411631:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625882.411634:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788625882.412109:0:7934:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788625882.412114:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788625882.412125:0:7934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788625882.486190:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13416 00000020:00000080:2.0:1788625882.486203:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcdc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625882.487475:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1342b 00000020:00000080:2.0:1788625882.487485:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcd8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788625882.487491:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788625882.487499:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.487508:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625882.487513:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b4350f94d40) has no exports 00000004:01000000:2.0:1788625882.487683:0:12926:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788625882.487691:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13669 00000020:00000080:2.0:1788625882.487708:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b4241b59000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788625882.487712:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788625882.487715:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.487721:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625882.487724:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b43797899c0) has no exports 00000020:00000080:2.0:1788625882.487755:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13662 00000020:00000080:2.0:1788625882.487760:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b4378fb0800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788625882.488108:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788625882.488113:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625882.488118:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788625882.488123:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625882.488125:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625882.488153:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.488159:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625882.488164:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13582 00000020:00000080:2.0:1788625882.488167:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b437fc61800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788625882.488171:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788625882.488175:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.488178:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625882.488180:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b4346394d40) has no exports 00000020:00000080:2.0:1788625882.488183:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1357b 00000020:00000080:2.0:1788625882.488186:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcda800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788625882.488475:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788625882.488479:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788625882.488481:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788625882.488484:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625882.488486:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625882.488506:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.488510:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625882.488533:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.488536:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625882.488559:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13432 00000020:00000080:2.0:1788625882.488570:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcde000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788625882.488574:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788625882.488577:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.488580:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625882.488582:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b434fce0000) has no exports 00000020:00000080:2.0:1788625882.488601:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.488604:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788625882.488607:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13439 00000020:00000080:2.0:1788625882.488609:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcdb000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788625882.488616:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b4346652800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788625882.488619:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4346652800 3 00000020:01000004:2.0:1788625882.488621:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b4346652800 from lustre-MDT0000 00000020:00000080:2.0:1788625882.488637:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.488640:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788625882.488642:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b434fcda000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788625882.488644:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcda000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788625882.488652:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788625882.488718:0:12926:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788625882.488722:0:12926:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788625882.488725:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788625882.488755:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.488759:0:12926:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625882.488766:0:12926:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b43463c8800 d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625882.488771:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b4350f919c0) has exports, disconnecting them 00000020:00080000:2.0:1788625882.488775:0:12926:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b43463c8800), last request at 1788625642 00000020:00000080:2.0:1788625882.488788:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb133d7 00000020:00010000:2.0:1788625882.488792:0:12926:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b43463c8800: total 8 00000100:00080000:2.0:1788625882.488796:0:12926:0:(import.c:65:import_set_state_nolock()) ffff9b43463cb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788625882.488806:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b43463c8800): rc 0 00000020:00080000:2.0:1788625882.488809:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b4350f919c0) has no exports 00000100:00100000:2.0:1788625882.488889:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b4350282400:5835] 1 exiting: rc = 0 00000020:00010000:3.0:1788625882.489086:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b43463c8800: total 8 00010000:00010000:3.0:1788625882.489118:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b43463c8800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788625882.489148:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016800/0x8aede7274cb1391e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb13917 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489178:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4371016600/0x8aede7274cb1372d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb13726 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489189:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031000/0x8aede7274cb1392c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb13925 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489204:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4340031e00/0x8aede7274cb134ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb134e8 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798db600/0x8aede7274cb136f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb136ee expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489228:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d2c00/0x8aede7274cb136d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb136d2 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489240:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43429d3a00/0x8aede7274cb136e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb136e0 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489250:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43798da200/0x8aede7274cb13703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8aede7274cb136fc expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625882.489260:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b43463c8800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788625882.489273:0:5831:0:(genops.c:885:class_export_put()) final put ffff9b43463c8800/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c 00010000:00010000:3.0:1788625882.489279:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625882.489280:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625882.489282:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625882.489311:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b436ead1400:5834] 0 exiting: rc = 1 00000020:00000080:1.0:1788625882.489585:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcdc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625882.489598:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcd8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788625882.489609:0:11778:0:(genops.c:885:class_export_put()) final put ffff9b4376956000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788625882.489611:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4376956000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788625882.489614:0:11778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625882.489720:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4241b59000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788625882.489725:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4378fb0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625882.489752:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4378fb2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788625882.489756:0:11778:0:(genops.c:885:class_export_put()) final put ffff9b4379797800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788625882.489758:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4379797800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788625882.489761:0:11778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625882.489786:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fc61800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788625882.489791:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625882.489795:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b43795a2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788625882.489799:0:11778:0:(genops.c:885:class_export_put()) final put ffff9b437fc63000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788625882.489801:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fc63000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788625882.489804:0:11778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625882.489872:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcde000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788625882.489877:0:11778:0:(genops.c:885:class_export_put()) final put ffff9b434fcde800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788625882.489879:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcde800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788625882.489882:0:11778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788625882.490039:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b434fcdb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625882.490043:0:11778:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43463c8800/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c for MGS 00000020:00000080:1.0:1788625882.490079:0:11778:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b43463cb000 for MGS 00000100:00100000:0.0:1788625882.490271:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b436ead0c00:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788625882.490611:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490628:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490635:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490640:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490646:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490652:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490659:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490663:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490669:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490677:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490682:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490688:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490695:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490701:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490707:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490712:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490718:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490724:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490860:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490883:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490890:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490896:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490902:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490907:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490912:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490917:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490922:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490927:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490932:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490938:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490943:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490949:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490954:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490960:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490966:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490971:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490983:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490989:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.490995:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491002:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491007:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491012:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491018:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491023:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491028:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491034:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491039:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491044:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491050:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491056:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491070:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491076:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491082:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491087:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491093:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491099:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491105:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491110:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491116:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491122:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491127:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491132:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491137:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.491142:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788625882.491650:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788625882.491654:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788625882.492797:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b434fab2300 - data ffff9b43743d7798/ffff9b437991a000 00000020:01000000:2.0:1788625882.492913:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b435049c240 - data ffff9b43743aea20/ffff9b4347c4d400 00000020:00000080:2.0:1788625882.493375:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb133bb 00000020:00000080:2.0:1788625882.493383:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43451f2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788625882.493401:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b4346652800 from MGS, refs=2 00000020:01000004:2.0:1788625882.493404:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4346652800 2 00000020:01000004:2.0:1788625882.493419:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b4346652800 from MGS 00000020:00000080:2.0:1788625882.493442:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.493448:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788625882.493451:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43451f5800/MGS 00000020:00000080:2.0:1788625882.493454:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43451f5800/MGS for MGS 00000020:01000000:2.0:1788625882.493462:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788625882.493516:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788625882.493521:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.493527:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625882.493535:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b4348f96000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625882.493541:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b43795f3380) has exports, disconnecting them 00000020:00080000:2.0:1788625882.493545:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b4348f96000), last request at 1788625643 00000020:00000080:2.0:1788625882.493549:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13486 00000020:00080000:2.0:1788625882.493555:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b4348f96000): rc 0 00000020:00000080:2.0:1788625882.493560:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b4348f96000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788625882.494116:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788625882.494121:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625882.494125:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788625882.494130:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625882.494267:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625882.494272:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788625882.494276:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4346652800 1 00000020:00000080:2.0:1788625882.494280:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb133ad 00000020:00000080:2.0:1788625882.494284:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b43451f3000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788625882.494289:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788625882.494293:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625882.494296:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625882.494299:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b43516fcd40) has no exports 00000020:00000080:1.0:1788625882.494765:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43451f2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625882.494776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4348f96000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788625882.494782:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4350f99800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788625882.494788:0:37:0:(genops.c:885:class_export_put()) final put ffff9b4348f91800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788625882.494802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4348f91800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788625882.494805:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788625882.494854:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43451f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788625882.538643:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625882.538674:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788625882.538680:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b4346655800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788625882.538685:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4346655800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788625882.538697:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788625882.538824:0:12926:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b4346656800 00000020:01000000:3.0:1788625882.538844:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788625882.538848:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625882.538853:0:12926:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788625882.538857:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b4350f93380) has no exports 00000100:00100000:3.0:1788625882.538950:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b4358283800:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788625882.541548:0:6721:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b437f956000:6721] 3 exiting: rc = 0 00000100:00100000:0.0:1788625882.541823:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b4358283c00:5843] 2 exiting: rc = 0 00000100:00100000:2.0:1788625882.542400:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b4358282800:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.542569:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542576:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542582:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542587:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542592:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542597:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542602:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542607:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542612:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542617:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542623:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542628:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542633:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542638:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542644:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542649:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542655:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542661:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542668:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542674:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542678:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542683:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542689:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542694:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542715:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542721:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542752:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542760:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542764:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542769:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542774:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542780:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542785:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542791:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542797:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542802:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542807:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542813:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542818:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542822:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542827:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542832:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542838:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542844:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542850:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542855:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542861:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542880:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542885:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542890:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542896:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542901:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542906:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542912:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542917:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542922:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542927:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542932:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542937:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542952:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542957:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542962:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542967:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.542973:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625882.547112:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b4358283400:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788625882.548953:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b434354e800:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.549168:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549176:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549184:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549190:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549196:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549211:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549218:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549224:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549229:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549234:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549240:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549246:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549253:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549258:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549264:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549269:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549274:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549279:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549285:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549289:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549295:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549300:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549306:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549311:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549316:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549322:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549327:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549332:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549338:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549343:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549362:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549367:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549373:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549378:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549383:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549388:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549393:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549398:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549404:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549409:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549414:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549420:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549426:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549431:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549436:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549442:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549447:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549452:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549457:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549462:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549467:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549473:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549477:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549482:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549487:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549491:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549496:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549501:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549506:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549511:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549516:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549521:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549526:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.549531:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625882.550103:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b436f340000:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788625882.551082:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b436f341600:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.557444:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557472:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557479:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557485:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557492:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557500:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557507:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557512:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557518:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557525:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557542:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557549:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557555:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557560:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557567:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557573:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557578:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557584:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557590:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557596:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557602:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557608:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557626:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557634:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557640:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557646:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557652:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557658:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557664:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557670:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557678:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557684:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557691:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557697:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557716:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557724:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557754:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557761:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557766:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557771:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557777:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557783:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557789:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557795:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557801:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557807:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557829:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557837:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557842:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557848:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557854:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557860:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557961:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557968:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557976:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557982:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557989:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.557995:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558016:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558026:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558034:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558039:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558046:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.558059:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625882.569452:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b43504f3600:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1788625882.569624:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b43504f3800:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.571084:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571093:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571099:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571104:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571110:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571116:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571121:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571140:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571145:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571150:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571156:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571161:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571167:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571173:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571178:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571184:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571190:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571195:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571200:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571205:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571210:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571215:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571220:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571224:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571229:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571233:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571238:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571244:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571249:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571254:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571259:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571263:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571268:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571273:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571279:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571284:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571289:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571294:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571299:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571304:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571309:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571313:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571326:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571330:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571335:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571339:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571344:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571350:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571354:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571359:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571364:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571369:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571374:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571379:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571384:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571389:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571394:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571398:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571403:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571407:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571412:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571417:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571421:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.571426:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625882.572409:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b434354e200:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1788625882.572819:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b43504f2200:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.572891:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572898:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572903:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572909:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572915:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572921:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572926:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572931:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572935:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572940:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572946:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572951:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572970:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572975:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572980:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572985:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572990:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.572995:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573000:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573005:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573011:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573016:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573021:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573025:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573030:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573034:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573039:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573044:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573049:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573054:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573070:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573075:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573079:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573083:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573088:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573094:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573098:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573103:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573108:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573113:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573118:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573123:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573128:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573133:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573138:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573144:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573150:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573164:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573169:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573174:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573179:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573184:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573189:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573194:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573199:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573205:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573210:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573215:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573220:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573225:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573230:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573235:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573241:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573246:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573544:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b434354e000:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1788625882.573601:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b43504f2c00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.573642:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573648:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573654:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573658:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573663:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573669:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573674:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573679:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573685:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573690:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573696:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573701:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573706:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573712:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573717:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.573722:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575789:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575795:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575801:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575807:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575812:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575818:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575823:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575828:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575834:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575839:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575844:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575849:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575855:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575921:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575929:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575935:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575940:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575945:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575949:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575954:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575960:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575965:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575971:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575977:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575982:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575987:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575993:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.575998:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576003:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576009:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576014:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576018:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576023:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576028:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576033:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576055:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576112:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576120:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576125:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576129:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576134:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576139:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576144:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576148:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576152:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576158:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576163:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576169:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.576965:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b43435b9a00:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788625882.577188:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b4350ff1a00:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1788625882.577319:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b4350ff0600:5856] 2 exiting: rc = 0 00000100:00100000:3.0:1788625882.577377:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577385:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577390:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577395:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577401:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577406:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577411:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577417:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577422:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577429:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577435:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577441:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577448:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577453:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577459:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577465:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577470:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577489:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577497:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577518:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577524:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577531:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577539:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577545:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577551:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577556:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577563:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577570:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577575:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577581:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577586:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577593:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577600:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577606:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577613:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577619:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577625:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577631:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577637:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577643:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577650:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577673:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577680:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577686:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577693:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577699:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577705:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577711:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577717:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577723:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577749:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577757:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577762:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577768:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577779:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577784:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577790:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577796:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577801:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577807:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577812:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577817:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577823:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625882.577836:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788625882.584250:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625882.584267:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788625882.584274:0:12926:0:(genops.c:885:class_export_put()) final put ffff9b4350f98800/MDS_uuid 00000020:00000080:3.0:1788625882.584278:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4350f98800/MDS_uuid for MDS 00000020:01000000:3.0:1788625882.584284:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788625882.584418:0:12926:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788625883.379019:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625884.402946:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625885.428046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625886.127303:0:13081:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788625886.142212:0:13081:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788625886.142260:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.142276:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.142283:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.142290:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.142313:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625886.142318:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788625886.142354:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625886.142359:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625886.142365:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625886.142371:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9b437fca3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625886.142377:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625886.142378:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625886.142381:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788625886.143290:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143303:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143311:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143318:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143338:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625886.143344:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143351:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143358:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143365:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143386:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788625886.143390:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788625886.143408:0:13081:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788625886.143412:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1788625886.143428:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625886.143435:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143443:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798dba00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625886.143447:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143457:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625886.143465:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625886.143472:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625886.143475:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788625886.143477:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788625886.143530:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143537:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625886.143560:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143568:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43798dba00/0x8aede7274cb136ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb136f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143592:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625886.143595:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143600:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625886.143604:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143611:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625886.143618:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625886.143624:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625886.143626:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788625886.143629:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788625886.143641:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143648:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625886.143654:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143661:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3200/0x8aede7274cb136fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb13703 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143670:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625886.143673:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143684:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4371017c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625886.143687:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143695:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625886.143702:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625886.143708:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788625886.143710:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788625886.143712:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788625886.143722:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143748:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625886.143763:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143770:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4371017c00/0x8aede7274cb13925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8aede7274cb1392c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625886.143780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625886.143782:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625886.143784:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625886.143802:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845777536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625886.143862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625886.143919:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625886.143931:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845777664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625886.143953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625886.143980:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625886.143987:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845777792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625886.144023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625886.144050:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777536 00000100:00100000:3.0:1788625886.144056:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777536 00000100:00100000:3.0:1788625886.144086:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777664 00000100:00100000:3.0:1788625886.144089:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777664 00000100:00100000:3.0:1788625886.144097:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845777792 00000100:00100000:3.0:1788625886.144099:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845777792 00000100:00100000:3.0:1788625886.144114:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625886.144121:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1875509845777536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788625886.144126:0:7642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625886 with bad export cookie 10010911702690902999 00010000:00010000:1.0:1788625886.152593:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625886.152644:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625886.152655:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875509845777664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788625886.152663:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625886 with bad export cookie 10010911702690902999 00000100:00100000:1.0:1788625886.152791:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875509845777664:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (8835us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788625886.152799:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625886.152828:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625886.152832:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875509845777792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788625886.152837:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625886 with bad export cookie 10010911702690902999 00000100:00100000:1.0:1788625886.152869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875509845777792:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (8845us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788625886.152875:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788625886.152914:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788625886.152919:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b43451f6800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788625886.152923:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788625886.153954:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625886.154017:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:2.0:1788625886.154082:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625886.154093:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788625886.154098:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b43795f4d40) has no exports 00000020:00080000:2.0:1788625886.154128:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b43795f4d40) has no exports 00000020:01000000:2.0:1788625886.155940:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b4345e14720 - data ffff9b437fe58438/ffff9b4379781800 00000020:01000000:2.0:1788625886.156129:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b434f64f600 - data ffff9b424142a5e8/ffff9b424121a400 00000100:00100000:3.0:1788625886.177699:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1875509845777536:12345-0@lo:103:ldlm_bl.0 Request processed in 33572us (33831us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625886.177716:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788625886.215223:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.145@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788625886.215228:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788625886.215237:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43798ca300 x1875509845777536/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625902 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625886.215277:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43798cb480 x1875509845777664/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625902 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625886.215285:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43798c9f80 x1875509845777792/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625902 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625886.215311:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b43451f6800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788625886.217190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845777536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625886.217222:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3308:1875509845777664:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788625886.227008:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788625886.227018:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788625886.227020:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788625886.227025:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b43451f6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625886.227034:0:3311:0:(import.c:545:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 192 00000100:00080000:1.0:1788625886.227044:0:3311:0:(import.c:665:import_select_connection()) MGC192.168.201.145@tcp: import ffff9b43451f6800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625886.234599:0:3311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43805ce300 x1875509845777920/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625886.234649:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3311:1875509845777792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625886.238939:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3307:1875509845777920:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788625886.239321:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509845777920 offset 0 length 520: 4 00100000:10000000:3.0:1788625886.261297:0:13081:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788625886.294592:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb1350b 00000020:00000080:1.0:1788625886.294602:0:13081:0:(genops.c:885:class_export_put()) final put ffff9b4350f9b000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788625886.294627:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b4377f6e800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788625886.294631:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4377f6e800 2 00000020:01000004:1.0:1788625886.294634:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b4377f6e800 from lustre-OST0000 00000020:00000080:1.0:1788625886.294655:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625886.294665:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788625886.294669:0:13081:0:(genops.c:885:class_export_put()) final put ffff9b43803f6800/lustre-OST0000_UUID 00000020:00000080:1.0:1788625886.294673:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43803f6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788625886.294679:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788625886.294720:0:13081:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788625886.294724:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788625886.294760:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625886.294766:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788625886.294774:0:13081:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b437fca0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625886.294779:0:13081:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b434fce19c0) has exports, disconnecting them 00000020:00080000:1.0:1788625886.294783:0:13081:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b437fca0800), last request at 1788625662 00000020:00000080:1.0:1788625886.294787:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13535 00000020:00080000:1.0:1788625886.294794:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b437fca0800): rc 0 00000020:00000080:1.0:1788625886.294829:0:13081:0:(genops.c:885:class_export_put()) final put ffff9b437fca0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788625886.295523:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4350f9b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788625886.295533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fca0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788625886.305830:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788625886.305840:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625886.305845:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788625886.305853:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625886.306050:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625886.306060:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788625886.306068:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4377f6e800 1 00000020:00000080:2.0:1788625886.306075:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb134c5 00000020:00000080:2.0:1788625886.306084:0:13081:0:(genops.c:885:class_export_put()) final put ffff9b43441ec800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788625886.306090:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788625886.306096:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625886.306100:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625886.306104:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b43463919c0) has no exports 00000020:00000080:3.0:1788625886.306285:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b437fca3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788625886.306293:0:37:0:(genops.c:885:class_export_put()) final put ffff9b43795ba800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788625886.306297:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43795ba800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788625886.306308:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788625886.306368:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43441ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788625886.340057:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625886.340075:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788625886.340100:0:13081:0:(genops.c:885:class_export_put()) final put ffff9b43441ed800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788625886.340105:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43441ed800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788625886.340117:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788625886.340279:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b4377f6f800 00000020:02000400:3.0:1788625886.340328:0:13081:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788625886.587360:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625887.224227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788625887.224238:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625887.224242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788625887.224245:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788625887.224250:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625887.224259:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788625887.224265:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625887.224273:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b4379795000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1788625887.224318:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43801faa00 x1875509845778048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625887.224771:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845778048:0@lo:38:kworker.0 00000400:00000100:3.0:1788625887.229175:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509845778048 offset 0 length 520: 4 00010000:00010000:3.0:1788625887.604882:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625888.627122:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625889.453600:0:13232:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788625889.482307:0:13232:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788625889.482396:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.482434:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.482442:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.482450:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.482470:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625889.482476:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788625889.482501:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625889.482514:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43801faa00 x1875509845778048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625889.482540:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788625889.482547:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788625889.482553:0:13232:0:(import.c:65:import_set_state_nolock()) ffff9b4379795000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788625889.482558:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625889.482562:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43801faa00 x1875509845778048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625902 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625889.482569:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788625889.482572:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1788625889.483577:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625889.483588:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625889.483597:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43798da400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625889.483601:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625889.483610:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625889.483616:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625889.483622:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625889.483624:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788625889.483638:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788625889.483654:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b43451f6800 00010000:00010000:1.0:1788625889.483657:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625889.483664:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43798da400/0x8aede7274cb136d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb136d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625889.483676:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625889.483678:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625889.483679:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625889.483774:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845778048:0@lo:38:kworker.0 00010000:00010000:2.0:1788625889.484725:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.484765:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.484788:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.484796:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.485193:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625889.485204:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.485211:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.485218:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.485224:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.491965:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625889.491979:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.491992:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625889.491996:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492008:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625889.492016:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625889.492022:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625889.492024:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788625889.492039:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b43451f6800 00010000:00010000:3.0:1788625889.492042:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb136e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb136e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492096:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625889.492100:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492105:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4340030a00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625889.492108:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492115:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625889.492121:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625889.492126:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788625889.492128:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788625889.492131:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b43451f6800 00010000:00010000:3.0:1788625889.492134:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625889.492140:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625889.492141:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625889.492143:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625889.492538:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788625889.492546:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4340030a00/0x8aede7274cb13917 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb1391e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625889.492563:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788625889.492571:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788625889.492574:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788625889.492609:0:13232:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788625889.492614:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788625889.492621:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625889.492634:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788625889.492638:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b43795f19c0) has no exports 00000020:00080000:2.0:1788625889.492665:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b43795f19c0) has no exports 00000020:01000000:2.0:1788625889.494382:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b437a004780 - data ffff9b437ff16e58/ffff9b4379ca5800 00000020:01000000:2.0:1788625889.494556:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b4379931f00 - data ffff9b437ff8fbd0/ffff9b437f999c00 00010000:00010000:1.0:1788625889.494982:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788625889.511956:0:13232:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788625889.532449:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb135d6 00000020:00000080:2.0:1788625889.532459:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4378fb4800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788625889.532487:0:13232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b437fc51000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788625889.532492:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b437fc51000 2 00000020:01000004:2.0:1788625889.532496:0:13232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b437fc51000 from lustre-OST0001 00000020:00000080:2.0:1788625889.532520:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625889.532530:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788625889.532533:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4378fb7000/lustre-OST0001_UUID 00000020:00000080:2.0:1788625889.532536:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4378fb7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788625889.532543:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788625889.532645:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c->MGS 00010000:00010000:2.0:1788625889.532662:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625889.532674:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625889.532680:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788625889.532683:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788625889.532686:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788625889.532699:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b43451f6800 00010000:00010000:2.0:1788625889.532702:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43429d3800/0x8aede7274cb134e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb134ef expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625889.532718:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788625889.532882:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4378fb4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:2.0:1788625889.532970:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625889.532975:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625889.532977:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788625889.532979:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788625889.532992:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b43451f6800 00010000:00010000:2.0:1788625889.532995:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43798db800/0x8aede7274cb13726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8aede7274cb1372d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788625889.533014:0:13232:0:(import.c:65:import_set_state_nolock()) ffff9b43451f6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788625889.533019:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788625889.533021:0:13232:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788625889.533023:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788625889.533027:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788625889.533037:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b43805ce300 x1875509845777920/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788625896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788625889.533058:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788625889.533061:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788625889.533153:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c:3307:1875509845777920:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1788625889.533894:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788625889.533904:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb133c9 00000020:00000080:2.0:1788625889.533910:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4350f9d000/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c 00000020:01000000:2.0:1788625889.533928:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.145@tcp (flags='') 00000020:00000080:2.0:1788625889.533936:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625889.533951:0:13232:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625889.533955:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b4346390000) has no exports 10000000:01000000:0.0:1788625889.534009:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788625889.534097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4350f9d000/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c for MGC192.168.201.145@tcp 10000000:01000000:2.0:1788625889.534128:0:13232:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.145@tcp: client import never connected 00000100:00080000:2.0:1788625889.534130:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788625889.534132:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788625889.534134:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788625889.534148:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788625889.534190:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625889.534195:0:13232:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.145@tcp (uuid d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c) 00000020:01000000:2.0:1788625889.534200:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788625889.534203:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625889.534207:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625889.534211:0:13232:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b4379791000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625889.534216:0:13232:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b4379788000) has exports, disconnecting them 00000020:00080000:2.0:1788625889.534220:0:13232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b4379791000), last request at 1788625681 00000020:00000080:2.0:1788625889.534224:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb13600 00000020:00080000:2.0:1788625889.534235:0:13232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b4379791000): rc 0 00000020:00000080:2.0:1788625889.534238:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4379791000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788625889.534860:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b43451f6800 for MGC192.168.201.145@tcp 00000020:00000080:3.0:1788625889.534875:0:37:0:(genops.c:885:class_export_put()) final put ffff9b4351b32800/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c 00000020:00000080:3.0:1788625889.534877:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4351b32800/d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c for MGC192.168.201.145@tcp 00000020:01000000:3.0:1788625889.534882:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.145@tcp (d4bf3ff4-694d-4e7e-af7a-4eb7d1910d3c) 00000020:00000080:3.0:1788625889.535156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4379791000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788625889.555162:0:13232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788625889.555173:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625889.555178:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788625889.555186:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788625889.555333:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b4379795000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788625889.555460:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788625889.560219:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788625889.560579:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788625889.561086:0:8462:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9b4380a28600:8462] 2 exiting: rc = 0 00000100:00100000:2.0:1788625889.561238:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b4343857600:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788625889.563232:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b43490d7800:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1788625889.563601:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.564137:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b4350ff5200:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1788625889.564295:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b4350ff4e00:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1788625889.564377:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b436577ee00:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1788625889.564434:0:7642:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b4379926200:7642] 3 exiting: rc = 0 00000100:00100000:0.0:1788625889.566968:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.566978:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.566986:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.566992:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.566998:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567004:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567009:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567015:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567020:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567025:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567030:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567036:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567042:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567048:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567053:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567154:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567160:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567165:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567170:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567175:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567180:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567185:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567190:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567195:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567200:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567219:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567223:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567228:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567233:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567238:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567244:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567249:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567254:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567258:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567264:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567269:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567273:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567277:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567282:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567286:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567291:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567295:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567300:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567305:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567310:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567315:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567319:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567324:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567330:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567335:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567340:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567345:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567350:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567356:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567360:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567365:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567369:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567374:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567378:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567383:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567394:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567399:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567404:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.567409:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788625889.570357:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625889.570371:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788625889.570377:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4378fb1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788625889.570382:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4378fb1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788625889.570388:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788625889.570437:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b437fc51000 1 00000020:00000080:0.0:1788625889.570444:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8aede7274cb135a5 00000020:00000080:0.0:1788625889.570450:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b4380a1a000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788625889.570468:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788625889.570475:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625889.570480:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788625889.570483:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b43795f0000) has no exports 00000020:00000080:3.0:1788625889.570569:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b4380a1a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788625889.606224:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625889.606241:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788625889.606247:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b437fc51800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788625889.606251:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9b437fc51800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788625889.606264:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788625889.606496:0:13232:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b437fc50000 00000020:01000000:0.0:1788625889.606518:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788625889.606523:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625889.606527:0:13232:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625889.606530:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b4346393380) has no exports 00000020:00000080:0.0:1788625889.606554:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625889.606561:0:13232:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788625889.606563:0:13232:0:(genops.c:885:class_export_put()) final put ffff9b43441ee800/OSS_uuid 00000020:00000080:0.0:1788625889.606565:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9b43441ee800/OSS_uuid for OSS 00000020:01000000:0.0:1788625889.606569:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788625889.606597:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788625889.607628:0:8805:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b4350f58a00:8805] 3 exiting: rc = 0 00000100:00100000:0.0:1788625889.607715:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b434f459400:6698] 2 exiting: rc = 0 00000100:00100000:0.0:1788625889.607788:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b43480da000:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1788625889.607956:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b434f459e00:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1788625889.608167:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608175:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608181:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608187:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608193:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608198:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608204:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608209:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608213:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608219:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608224:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608229:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608234:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608239:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608245:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608251:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608256:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608262:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608267:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608273:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608278:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608283:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608288:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608294:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608299:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608304:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608310:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608316:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608322:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608327:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608332:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608337:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608342:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608357:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608362:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608367:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608372:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608376:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608382:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608387:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608391:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608396:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608402:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608407:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608413:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608421:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608426:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608432:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608437:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608442:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608447:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608453:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608459:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608464:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608469:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608475:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608480:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608485:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608491:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608496:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608502:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608508:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608514:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.608520:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625889.613600:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b435db11a00:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1788625889.614622:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b4343f82800:6699] 0 exiting: rc = 1 00000100:00100000:0.0:1788625889.614923:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614932:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614948:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614954:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614974:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614979:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614984:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614990:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614994:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.614999:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615004:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615022:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615028:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615033:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615038:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615043:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615048:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615053:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615058:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615064:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615069:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615074:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615079:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615084:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615089:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615094:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615099:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615104:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615109:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615114:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615120:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615126:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615131:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615136:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615141:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615146:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615152:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615161:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615166:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615179:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615184:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615189:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615194:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615199:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615205:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615211:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615217:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615222:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615228:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615234:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615239:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615247:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615255:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615260:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615265:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615270:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615274:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615279:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615283:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615288:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615293:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615297:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615302:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.615307:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.616135:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b435db11600:6703] 1 exiting: rc = 0 00000100:00100000:3.0:1788625889.624048:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b435db11200:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1788625889.624998:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b435db11800:6704] 2 exiting: rc = 0 00000100:00100000:0.0:1788625889.625118:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625127:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625133:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625138:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625144:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625150:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625163:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625172:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625177:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625201:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625207:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625214:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625220:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625226:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625232:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625238:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625244:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625249:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625256:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625261:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625267:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625272:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625277:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625298:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625304:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625310:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625315:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625321:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625326:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625331:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625337:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625357:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625363:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625369:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625377:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625382:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625387:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625392:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625396:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625401:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625406:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625412:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625417:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625421:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625434:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625439:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625445:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625450:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625456:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625462:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625468:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625473:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625478:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625485:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625490:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625496:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625502:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625508:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625513:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625518:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625524:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625529:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625533:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.625547:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625889.642421:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b4350f58000:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1788625889.643398:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b435db10400:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1788625889.644928:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644949:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644956:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644962:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644967:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644971:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644976:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644981:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644987:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644992:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.644997:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645002:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645007:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645036:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645041:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645046:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645051:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645056:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645062:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645067:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645072:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645077:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645082:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645087:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645120:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645128:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645132:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645136:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645141:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645145:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645149:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645154:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645159:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645163:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645169:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645174:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645179:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645185:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645190:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645196:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645202:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645206:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645211:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645216:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645221:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645226:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645231:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645235:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645249:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645256:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645261:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645266:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645271:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645276:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645281:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645453:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645461:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645466:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645472:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645476:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645481:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645486:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645490:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.645495:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625889.647001:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b435db10a00:6707] 0 exiting: rc = 1 00000100:00100000:0.0:1788625889.647181:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b435db10800:6708] 1 exiting: rc = 0 00000100:00100000:2.0:1788625889.647447:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647462:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647469:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647476:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647481:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647487:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647503:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647510:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647516:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647522:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647528:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647533:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647539:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647544:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647551:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647556:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647561:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647567:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647584:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647601:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647606:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647612:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647618:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647624:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647629:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647635:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647642:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647647:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647652:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647658:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647676:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647682:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647689:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647695:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647701:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647706:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647711:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647717:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647724:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647868:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647875:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647881:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647902:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647912:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647918:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647924:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647930:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647947:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647953:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647959:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647965:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647971:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647976:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.647981:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648005:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648011:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648017:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648023:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648029:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648034:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648040:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648045:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648052:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625889.648062:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788625889.673947:0:13232:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788625910.882341:0:13847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788625919.197049:0:14307:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625919.197053:0:14307:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788625919.197179:0:14307:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b437996b800 00000020:01000004:3.0:1788625919.197196:0:14307:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788625919.197205:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788625919.197219:0:14307:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b4346393380) 00000020:00000080:3.0:1788625919.197233:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788625919.211471:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788625919.213546:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788625919.213961:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788625919.214018:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788625919.214080:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788625919.214208:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788625919.214299:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788625919.214453:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788625919.214535:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788625919.214869:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:1.0:1788625919.215928:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 456: rc = 0 00100000:10000000:1.0:1788625919.216017:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 456: rc = 0 00100000:10000000:1.0:1788625919.216554:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.216884:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 103: rc = 0 00100000:10000000:1.0:1788625919.217223:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.221985:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 103: rc = 0 00100000:10000000:1.0:1788625919.222339:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 103: rc = 0 00100000:10000000:1.0:1788625919.222614:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.223077:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.223408:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 103: rc = 0 00100000:10000000:1.0:1788625919.223663:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 103: rc = 0 00100000:10000000:1.0:1788625919.223921:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 103: rc = 0 00100000:10000000:1.0:1788625919.224238:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.224480:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 103: rc = 0 00100000:10000000:1.0:1788625919.224911:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 316: rc = 0 00100000:10000000:1.0:1788625919.225287:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 316: rc = 0 00100000:10000000:1.0:1788625919.225686:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 316: rc = 0 00100000:10000000:1.0:1788625919.225952:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 316: rc = 0 00100000:10000000:1.0:1788625919.226273:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 316: rc = 0 00100000:10000000:1.0:1788625919.226537:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 316: rc = 0 00100000:10000000:1.0:1788625919.226856:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 316: rc = 0 00100000:10000000:1.0:1788625919.227093:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 316: rc = 0 00100000:10000000:1.0:1788625919.227431:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 316: rc = 0 00100000:10000000:1.0:1788625919.227682:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 316: rc = 0 00100000:10000000:1.0:1788625919.227944:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 316: rc = 0 00100000:10000000:1.0:1788625919.228253:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 316: rc = 0 00100000:10000000:1.0:1788625919.228498:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 316: rc = 0 00100000:10000000:1.0:1788625919.228839:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 316: rc = 0 00100000:10000000:1.0:1788625919.229068:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 316: rc = 0 00100000:10000000:1.0:1788625919.229547:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 316: rc = 0 00100000:10000000:1.0:1788625919.229833:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 316: rc = 0 00100000:10000000:1.0:1788625919.230098:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 316: rc = 0 00100000:10000000:1.0:1788625919.230416:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 316: rc = 0 00100000:10000000:1.0:1788625919.230670:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 316: rc = 0 00100000:10000000:1.0:1788625919.231083:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 316: rc = 0 00100000:10000000:1.0:1788625919.231332:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 316: rc = 0 00100000:10000000:1.0:1788625919.231587:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 316: rc = 0 00100000:10000000:1.0:1788625919.231855:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 316: rc = 0 00100000:10000000:1.0:1788625919.232090:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 316: rc = 0 00100000:10000000:1.0:1788625919.232327:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 316: rc = 0 00100000:10000000:1.0:1788625919.232570:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 316: rc = 0 00100000:10000000:1.0:1788625919.232841:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 316: rc = 0 00100000:10000000:1.0:1788625919.233079:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 316: rc = 0 00100000:10000000:1.0:1788625919.233337:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 316: rc = 0 00100000:10000000:1.0:1788625919.233891:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 316: rc = 0 00100000:10000000:1.0:1788625919.234290:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 316: rc = 0 00100000:10000000:1.0:1788625919.234660:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 459: rc = 0 00100000:10000000:1.0:1788625919.235297:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788625919.235466:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 306: rc = 0 00100000:10000000:1.0:1788625919.235638:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788625919.235696:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 306: rc = 0 00100000:10000000:1.0:1788625919.235897:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788625919.235957:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 306: rc = 0 00100000:10000000:1.0:1788625919.236347:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788625919.236407:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 457: rc = 0 00100000:10000000:1.0:1788625919.236604:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788625919.236668:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 457: rc = 0 00100000:10000000:1.0:1788625919.236950:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788625919.237012:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 457: rc = 0 00000020:00000080:1.0:1788625919.237363:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788625919.237560:0:14307:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788625919.237572:0:14307:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb146ca 00000020:01000004:1.0:1788625919.237580:0:14307:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788625919.237585:0:14307:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788625919.237590:0:14307:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b437996b800 from MGS 00000020:01000004:1.0:1788625919.237594:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788625919.237603:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b43797899c0) 00000020:00000080:1.0:1788625919.237614:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788625919.237669:0:14307:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b437996b800 from MGS, refs=2 00080000:01000000:1.0:1788625919.237674:0:14307:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625919.237680:0:14307:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb146d8 00000100:00100000:1.0:1788625919.237803:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788625919.237936:0:14307:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788625919.237943:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788625919.238511:0:14307:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788625919.238517:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788625919.239344:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625919.239508:0:14307:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788625919.239514:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788625919.239947:0:14307:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788625919.239953:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788625919.240376:0:14307:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788625919.240382:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788625919.241075:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625919.241079:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625919.241081:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625919.241594:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625919.241597:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625919.241599:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625919.242068:0:14307:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788625919.247229:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788625919.251374:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788625919.251392:0:14307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788625919.251395:0:14307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788625919.252754:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788625919.252894:0:14307:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788625919.252986:0:14307:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788625919.253677:0:14307:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788625919.256261:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625919.256611:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788625919.256618:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788625919.257109:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788625919.257174:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788625919.257543:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788625919.257550:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788625919.260623:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788625919.260645:0:14307:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:0.0:1788625919.260652:0:14307:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788625919.260682:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:0.0:1788625919.260695:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (ffff9b434fce3380) 00000020:00000080:0.0:1788625919.260709:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788625919.260815:0:14307:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b437f987800@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1788625919.260958:0:14307:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:0.0:1788625919.260965:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788625919.261293:0:14321:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788625919.266350:0:14322:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788625919.266456:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid b37dd17e-8565-48d9-9dd1-803cb11c3fc0) 00000020:00000080:0.0:1788625919.266481:0:14307:0:(genops.c:1385:class_connect()) connect: client b37dd17e-8565-48d9-9dd1-803cb11c3fc0, cookie 0x8aede7274cb146e6 00000100:00080000:0.0:1788625919.266494:0:14307:0:(import.c:545:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625919.266500:0:14307:0:(import.c:665:import_select_connection()) MGC192.168.201.145@tcp: import ffff9b437f987800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625919.266530:0:14307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b4345f3df80 x1875509845778176/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625919.266559:0:14307:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b37dd17e-8565-48d9-9dd1-803cb11c3fc0->MGS 00000020:01000004:0.0:1788625919.266580:0:14307:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788625919.266585:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788625919.266599:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b434fce4d40) 00000020:00000080:0.0:1788625919.266610:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788625919.268936:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3307:1875509845778176:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788625919.269019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625919.274272:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778176 00000100:00100000:2.0:1788625919.274285:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778176 00000100:00100000:2.0:1788625919.274325:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625919.274333:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3307:x1875509845778176:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788625919.274359:0:14319:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b37dd17e-8565-48d9-9dd1-803cb11c3fc0@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1788625919.274385:0:14319:0:(genops.c:1385:class_connect()) connect: client b37dd17e-8565-48d9-9dd1-803cb11c3fc0, cookie 0x8aede7274cb146f4 00000100:00080000:2.0:1788625919.274525:0:14319:0:(import.c:65:import_set_state_nolock()) ffff9b43463ea000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625919.274617:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+5:3307:x1875509845778176:12345-0@lo:250:mount.lustre.0 Request processed in 283us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.274624:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625919.274793:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788625919.274803:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:2.0:1788625919.274818:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788625919.274823:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788625919.274826:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b437f987800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788625919.274829:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788625919.274838:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788625919.274843:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3307:1875509845778176:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788625919.282577:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625919.286795:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625919.286807:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788625919.287609:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788625919.287616:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788625919.287938:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625919.287944:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788625919.288580:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625919.288779:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788625919.288784:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788625919.289293:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788625919.289299:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788625919.332623:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625919.332874:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788625919.332881:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788625919.340332:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788625919.340348:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788625919.341030:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625919.341230:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788625919.341236:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788625919.341558:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788625919.341565:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788625919.342491:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625919.342637:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788625919.342642:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788625919.343755:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788625919.343764:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788625919.344454:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625919.345167:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788625919.345182:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788625919.345933:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625919.345941:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788625919.361211:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625919.361409:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625919.361416:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788625919.366072:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625919.366084:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788625919.369953:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625919.369969:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788625919.370955:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788625919.370978:0:14307:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788625919.370984:0:14307:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788625919.371121:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788625919.371154:0:14307:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788625919.371159:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788625919.371160:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625919.371162:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625919.371163:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625919.371164:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625919.371165:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625919.371166:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625919.371167:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625919.371169:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625919.371170:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625919.371172:0:14307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788625919.371175:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625919.371176:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625919.371177:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625919.371178:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625919.371179:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625919.371180:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625919.371181:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625919.371182:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625919.371183:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625919.371184:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625919.371210:0:14307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625919.371230:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778304:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625919.371310:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.371370:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db25180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.371435:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778304 00000100:00100000:2.0:1788625919.371443:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778304 00000100:00100000:2.0:1788625919.371492:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625919.371501:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+5:14307:x1875509845778304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625919.371542:0:14320:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625919.371545:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788625919.371548:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788625919.371915:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788625919.372263:0:14320:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788625919.373253:0:14341:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788625919.373259:0:14341:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788625919.373261:0:14341:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788625919.373294:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788625919.382959:0:14320:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625919.382972:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788625919.402176:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+5:14307:x1875509845778304:12345-0@lo:253:mount.lustre.0 Request processed in 30666us (30857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625919.402195:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625919.402335:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788625919.402352:0:14307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788625919.402355:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625919.402357:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788625919.402358:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625919.402359:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625919.402360:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625919.402361:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625919.402363:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625919.402364:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788625919.402366:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625919.402368:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625919.402391:0:14307:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b437996b800 from lustre-MDT0000 10000000:01000000:3.0:1788625919.402415:0:14307:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788625919.402427:0:14307:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788625919.402431:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b434fce3380 10000000:01000000:3.0:1788625919.402436:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625919.402443:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b434fce3380 from 1 10000000:01000000:3.0:1788625919.402446:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788625919.402481:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.402493:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.402503:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.402521:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625919.402571:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.402612:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625919.402665:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778432 00000100:00100000:0.0:1788625919.402672:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778432 00000100:00100000:0.0:1788625919.402710:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625919.402719:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+5:14307:x1875509845778432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625919.402759:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625919.402775:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4380742c00/0x8aede7274cb14702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb146fb expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.402798:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4380742c00/0x8aede7274cb14702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb146fb expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.402808:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4380742c00/0x8aede7274cb14702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb146fb expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.402817:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742c00, rc 0) 00000100:00100000:0.0:1788625919.402850:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+6:14307:x1875509845778432:12345-0@lo:101:mount.lustre.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625919.402855:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625919.402989:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625919.403002:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.403012:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.403065:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625919.403088:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.403116:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625919.403754:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778560 00000100:00100000:0.0:1788625919.403761:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778560 00000100:00100000:0.0:1788625919.403797:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625919.403816:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+6:14307:x1875509845778560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625919.404044:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+6:14307:x1875509845778560:12345-0@lo:501:mount.lustre.0 Request processed in 228us (954us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625919.404052:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625919.404149:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788625919.404181:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788625919.404201:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404211:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625919.404220:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b437996b800 10000000:01000000:3.0:1788625919.404234:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788625919.404238:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b437996b800 10000000:01000000:3.0:1788625919.404241:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788625919.404243:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b437996b800 from 1 10000000:01000000:3.0:1788625919.404246:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788625919.404266:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404280:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404288:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.404303:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625919.404331:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.404357:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.404376:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778688 00000100:00100000:3.0:1788625919.404380:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778688 00000100:00100000:3.0:1788625919.404406:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625919.404413:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+6:14307:x1875509845778688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625919.404431:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625919.404445:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f6000/0x8aede7274cb14710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14709 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404463:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6000/0x8aede7274cb14710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14709 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404472:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f6000/0x8aede7274cb14710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14709 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404479:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f6000, rc 0) 00000100:00100000:3.0:1788625919.404506:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+7:14307:x1875509845778688:12345-0@lo:101:mount.lustre.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.404511:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625919.404541:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625919.404552:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14710 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404559:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14710 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625919.404569:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788625919.404573:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14710 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404579:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7000/0x8aede7274cb14709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14710 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625919.404585:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788625919.404588:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625919.404592:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b437996b800 10000000:01000000:3.0:1788625919.404594:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788625919.404597:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788625919.404599:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625919.404610:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404617:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404625:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.404637:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625919.404817:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.404831:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.404847:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778816 00000100:00100000:3.0:1788625919.404850:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778816 00000100:00100000:3.0:1788625919.404867:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625919.404872:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+7:14307:x1875509845778816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625919.404879:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625919.404887:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7800/0x8aede7274cb1471e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14717 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404900:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7800/0x8aede7274cb1471e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14717 expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404908:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7800/0x8aede7274cb1471e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14717 expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404915:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7800, rc 0) 00000100:00100000:3.0:1788625919.404942:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+8:14307:x1875509845778816:12345-0@lo:101:mount.lustre.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.404948:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625919.404971:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625919.404981:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1471e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.404988:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1471e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.405024:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625919.405053:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.405062:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.405079:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845778944 00000100:00100000:3.0:1788625919.405083:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845778944 00000100:00100000:3.0:1788625919.405101:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625919.405107:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+8:14307:x1875509845778944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625919.406828:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14307:x1875509845778944:12345-0@lo:501:mount.lustre.0 Request processed in 1717us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.406839:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625919.407213:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845778944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625919.407268:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625919.407316:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.411369:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348abcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625919.428350:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779072 00000100:00100000:1.0:1788625919.428364:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779072 00000100:00100000:1.0:1788625919.428442:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625919.428453:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14307:x1875509845779072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625919.429405:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14307:x1875509845779072:12345-0@lo:503:mount.lustre.0 Request processed in 950us (22085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625919.429430:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625919.430981:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625919.433490:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14342:1875509845779200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625919.433569:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625919.433615:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.433667:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779200 00000100:00100000:3.0:1788625919.433674:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779200 00000100:00100000:3.0:1788625919.433718:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625919.433748:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14342:x1875509845779200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625919.434073:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14342:x1875509845779200:12345-0@lo:502:llog_process_th.0 Request processed in 345us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.434080:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625919.434468:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14342:1875509845779200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625919.434497:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625919.434508:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.434510:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788625919.434516:0:14342:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788625919.434519:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625919.434532:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b43516f8000) 00000020:00000080:2.0:1788625919.434550:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788625919.434555:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788625919.434618:0:14342:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788625919.434626:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb1472c 00000020:00000080:2.0:1788625919.434865:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788625919.434869:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625919.434873:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.434874:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788625919.434877:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625919.434880:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.434881:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788625919.434885:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625919.434891:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b43516f99c0) 00000020:00000080:2.0:1788625919.434899:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788625919.434902:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788625919.434904:0:14342:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788625919.434906:0:14342:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788625919.434911:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788625919.434948:0:14342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b437996b800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788625919.434959:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b43516fb380) 00000020:00000080:2.0:1788625919.434966:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788625919.435024:0:14342:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788625919.435030:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb14741 00000020:00000080:2.0:1788625919.435121:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788625919.435133:0:14342:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788625919.435137:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8aede7274cb14748 00080000:01000000:2.0:1788625919.435143:0:14342:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788625919.435146:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb1474f 00010000:00010000:0.0:1788625919.532026:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788625919.532674:0:14342:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788625919.532941:0:14342:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788625919.533724:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b434fce19c0) 00000020:00000080:0.0:1788625919.533927:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788625919.533987:0:14342:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788625919.533993:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb1475d 00000020:00000080:0.0:1788625919.535173:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788625919.548054:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8aede7274cb14764 00000020:00000080:0.0:1788625919.548649:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788625919.548661:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625919.548667:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.548669:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788625919.548673:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625919.548679:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.548680:0:14342:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788625919.548684:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788625919.548714:0:14342:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788625919.548774:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625919.548778:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.548779:0:14342:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788625919.548782:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788625919.548784:0:14342:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1788625919.548786:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788625919.548788:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788625919.548789:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788625919.548791:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.548793:0:14342:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788625919.548795:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625919.548798:0:14342:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788625919.548802:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.548803:0:14342:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788625919.548806:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625919.548811:0:14342:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:0.0:1788625919.548836:0:14342:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788625919.548839:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625919.548852:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b434fce0000) 00000020:00000080:0.0:1788625919.548865:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788625919.548869:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625919.548929:0:14342:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788625919.548934:0:14342:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788625919.548941:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb14772 00010000:00080000:0.0:1788625919.548970:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b436f36b000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1788625919.549178:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788625919.549489:0:14342:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788625919.549536:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788625919.550402:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625919.550471:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788625919.550539:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788625919.551235:0:14346:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788625919.551244:0:14346:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625919.552055:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625919.552066:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625919.552096:0:14342:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625919.552113:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb14779 00000100:00080000:2.0:1788625919.552124:0:14342:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625919.552130:0:14342:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b436f36b000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625919.552165:0:14342:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43805cca80 x1875509845779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625919.552194:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788625919.552370:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625919.552374:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.552376:0:14342:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625919.552379:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625919.552382:0:14342:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788625919.552383:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625919.552385:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625919.552386:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625919.552389:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.552390:0:14342:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625919.552393:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625919.552396:0:14342:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788625919.552400:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.552401:0:14342:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788625919.552404:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625919.552408:0:14342:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:2.0:1788625919.552441:0:14342:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788625919.552445:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625919.552462:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b43516fcd40) 00000020:00000080:2.0:1788625919.552475:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788625919.552481:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625919.552533:0:14342:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788625919.552539:0:14342:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788625919.552544:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8aede7274cb14787 00010000:00080000:2.0:1788625919.552570:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b434fcde800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:2.0:1788625919.552829:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788625919.552991:0:14342:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625919.553012:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788625919.553330:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845779328:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788625919.553382:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509845779328 offset 0 length 520: 4 00000040:00080000:2.0:1788625919.553952:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625919.554013:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788625919.554080:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788625919.554713:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788625919.554718:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788625919.555548:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625919.555560:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625919.555591:0:14342:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788625919.555609:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb1478e 00000100:00080000:2.0:1788625919.555621:0:14342:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625919.555626:0:14342:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625919.555661:0:14342:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43805cea00 x1875509845779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625919.555721:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845779456:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788625919.555793:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509845779456 offset 0 length 520: 4 00000100:00080000:2.0:1788625919.555860:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788625919.555913:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625919.555917:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.555919:0:14342:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788625919.555922:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625919.555925:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.555926:0:14342:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625919.555929:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625919.555930:0:14342:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625919.555932:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625919.555940:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.555942:0:14342:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788625919.555945:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625919.555947:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.555948:0:14342:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625919.555952:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788625919.555978:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14342:1875509845779584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625919.556025:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625919.556041:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625919.556181:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779584 00000100:00100000:1.0:1788625919.556189:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779584 00000100:00100000:1.0:1788625919.556242:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625919.556251:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14342:x1875509845779584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625919.556497:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14342:x1875509845779584:12345-0@lo:502:llog_process_th.0 Request processed in 246us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625919.556505:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625919.556683:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14342:1875509845779584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625919.556707:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625919.556711:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625919.556713:0:14342:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625919.556718:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788625919.556965:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788625919.556985:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788625919.557032:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1471e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.557043:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6400/0x8aede7274cb14717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1471e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625919.557051:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b437996b800 from 1 10000000:01000000:0.0:1788625919.557054:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625919.557080:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.557088:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.557096:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.557111:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625919.557140:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.557174:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625919.557236:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779712 00000100:00100000:1.0:1788625919.557241:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779712 00000100:00100000:1.0:1788625919.557271:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625919.557278:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+9:14307:x1875509845779712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625919.557288:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625919.557302:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14795 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.557323:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14795 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.557333:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14795 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.557340:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4ca00, rc 0) 00000100:00100000:1.0:1788625919.557368:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+10:14307:x1875509845779712:12345-0@lo:101:mount.lustre.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625919.557374:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625919.557491:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625919.557503:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.557527:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.558075:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779840:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788625919.558114:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.558139:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625919.558159:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779840 00000100:00100000:0.0:1788625919.558163:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779840 00000100:00100000:0.0:1788625919.558192:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625919.558199:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+10:14307:x1875509845779840:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788625919.558214:0:14319:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788625919.558293:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788625919.558362:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+10:14307:x1875509845779840:12345-0@lo:256:mount.lustre.0 Request processed in 164us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625919.558369:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625919.558404:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779840:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788625919.558992:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625919.559302:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.559314:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625919.559322:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437996b800 from 1 10000000:01000000:0.0:1788625919.559325:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625919.559352:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.559370:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.559380:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.559396:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625919.559446:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.559545:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625919.559581:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845779968 00000100:00100000:1.0:1788625919.559593:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845779968 00000100:00100000:1.0:1788625919.559662:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625919.559671:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+10:14307:x1875509845779968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625919.559681:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625919.559694:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb147a3 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.559712:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.559722:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625919.559759:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d000, rc 0) 00000100:00100000:1.0:1788625919.559795:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845779968:12345-0@lo:101:mount.lustre.0 Request processed in 126us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625919.559801:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625919.559902:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845779968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625919.559916:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.559924:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.559969:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625919.559993:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.560120:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.560176:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780096 00000100:00100000:2.0:1788625919.560181:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780096 00000100:00100000:2.0:1788625919.560201:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625919.560207:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845780096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625919.560696:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845780096:12345-0@lo:501:mount.lustre.0 Request processed in 487us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.560703:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625919.560802:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625919.560828:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625919.560864:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.560890:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.560928:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780224 00000100:00100000:2.0:1788625919.560932:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780224 00000100:00100000:2.0:1788625919.560948:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625919.560954:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845780224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625919.561082:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845780224:12345-0@lo:503:mount.lustre.0 Request processed in 127us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.561089:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625919.561155:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625919.561714:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14350:1875509845780352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625919.561794:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.561816:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.561888:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780352 00000100:00100000:2.0:1788625919.561892:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780352 00000100:00100000:2.0:1788625919.561924:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625919.561931:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14350:x1875509845780352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625919.562112:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14350:x1875509845780352:12345-0@lo:502:llog_process_th.0 Request processed in 181us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.562119:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625919.562195:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14350:1875509845780352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625919.562229:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625919.562238:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625919.562240:0:14350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625919.562247:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b437996b800 00000020:00000080:3.0:1788625919.562255:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625919.562263:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625919.562266:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625919.562267:0:14350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625919.562270:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625919.562273:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625919.562274:0:14350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625919.562277:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b437996b800 00000020:00000080:3.0:1788625919.562280:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625919.562332:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625919.563960:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625919.563966:0:14350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625919.563975:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625919.563980:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625919.563981:0:14350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625919.563987:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b437996b800 00000020:00000080:3.0:1788625919.563989:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625919.568868:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14350:1875509845780480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625919.568952:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.568996:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.570201:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780480 00000100:00100000:3.0:1788625919.570211:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780480 00000100:00100000:3.0:1788625919.570328:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625919.570337:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14350:x1875509845780480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625919.571327:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14350:x1875509845780480:12345-0@lo:502:llog_process_th.0 Request processed in 987us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.571337:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625919.574850:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14350:1875509845780480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625919.574896:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625919.574904:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625919.574907:0:14350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788625919.574913:0:14350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788625919.579135:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788625919.579173:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625919.580325:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.580343:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625919.580400:0:14307:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788625919.580403:0:14307:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b437996b800 10000000:01000000:2.0:1788625919.580406:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b437996b800 10000000:01000000:2.0:1788625919.580411:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625919.580429:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b437996b800 from 1 10000000:01000000:2.0:1788625919.580433:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625919.580474:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.580483:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.580495:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625919.580533:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625919.580603:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625919.580653:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.581982:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780608 00000100:00100000:2.0:1788625919.581992:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780608 00000100:00100000:2.0:1788625919.582051:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625919.582062:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845780608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625919.582077:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625919.582095:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94a600/0x8aede7274cb147b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb147b1 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.582121:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94a600/0x8aede7274cb147b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb147b1 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.582133:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94a600/0x8aede7274cb147b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147b1 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.582142:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a600, rc 0) 00000100:00100000:2.0:1788625919.582196:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845780608:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.582203:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625919.582355:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625919.582371:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147b8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.582381:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb147b8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625919.582462:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625919.582492:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625919.584345:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434f89f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625919.586392:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780736 00000100:00100000:3.0:1788625919.586406:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780736 00000100:00100000:3.0:1788625919.586537:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625919.586549:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845780736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625919.588018:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845780736:12345-0@lo:501:mount.lustre.0 Request processed in 1466us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.588039:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625919.588190:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625919.588258:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625919.588304:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.588475:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.590535:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780864 00000100:00100000:2.0:1788625919.590549:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780864 00000100:00100000:2.0:1788625919.590612:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625919.590622:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845780864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625919.590880:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845780864:12345-0@lo:503:mount.lustre.0 Request processed in 259us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.590888:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625919.590908:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845780864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625919.591397:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14356:1875509845780992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625919.591453:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.591694:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347f6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.591884:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845780992 00000100:00100000:2.0:1788625919.591891:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845780992 00000100:00100000:2.0:1788625919.591921:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625919.591929:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14356:x1875509845780992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625919.592080:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14356:x1875509845780992:12345-0@lo:502:llog_process_th.0 Request processed in 151us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.592087:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625919.592107:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14356:1875509845780992:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788625919.592171:0:14356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788625919.592185:0:14356:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b4346390000) 00000020:00000080:3.0:1788625919.592205:0:14356:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788625919.592267:0:14356:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b437996b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788625919.592271:0:14356:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b437996b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788625919.592274:0:14356:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b437996b800 4 00010000:00080000:3.0:1788625919.592300:0:14356:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b4348f91000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1788625919.594689:0:14356:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788625919.595351:0:14356:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788625919.595592:0:14356:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625919.595607:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8aede7274cb147c6 00000100:00080000:3.0:1788625919.595619:0:14356:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625919.595625:0:14356:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b4348f91000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625919.595658:0:14356:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798ca680 x1875509845781120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625919.595689:0:14356:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788625919.596339:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845781120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625919.596408:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.596475:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781120 00000100:00100000:3.0:1788625919.596483:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781120 00000100:00100000:3.0:1788625919.596603:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625919.596611:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845781120:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625919.596675:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875509845781120:12345-0@lo:38:llog_process_th.0 Request processed in 62us (266us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788625919.596689:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625919.596775:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625919.596784:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4348f91000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625919.596788:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788625919.596791:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845781120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625919.596812:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14356:1875509845781248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625919.596864:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.596894:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347f6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788625919.597067:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781248 00000100:00100000:0.0:1788625919.597071:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781248 00000100:00100000:0.0:1788625919.597108:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625919.597116:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14356:x1875509845781248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625919.597409:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14356:x1875509845781248:12345-0@lo:502:llog_process_th.0 Request processed in 294us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625919.597432:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625919.598660:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14356:1875509845781248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625919.598700:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788625919.599330:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788625919.599351:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625919.599375:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147b8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.599387:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b434f94ae00/0x8aede7274cb147b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147b8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625919.599455:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625919.599457:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625919.599459:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625919.599460:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625919.599461:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625919.599462:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625919.599463:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625919.599465:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625919.599467:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625919.599468:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625919.599472:0:14307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788625919.599474:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625919.599476:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625919.599477:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625919.599478:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625919.599479:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625919.599480:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625919.599481:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625919.599482:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625919.599484:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625919.599485:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625919.599511:0:14307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625919.599526:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845781376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625919.599587:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.599626:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.599680:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781376 00000100:00100000:2.0:1788625919.599692:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781376 00000100:00100000:2.0:1788625919.599766:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625919.599781:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14307:x1875509845781376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625919.599808:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625919.599829:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625919.667015:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625919.667031:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788625919.667049:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625919.667054:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625919.667076:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.667096:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14795 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.667106:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.667146:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.667157:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 12 pid: 14318 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.667169:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845781504:0@lo:104: 00000100:00100000:0.0:1788625919.667365:0:14340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625919.667455:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625919.667513:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781504 00000100:00100000:2.0:1788625919.667520:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781504 00000100:00100000:2.0:1788625919.667700:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625919.667711:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845781504:12345-0@lo:104: 00010000:00010000:2.0:1788625919.667724:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625919.668471:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625919.668479:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845781504:12345-0@lo:104: Request processed in 770us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625919.668486:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788625919.668529:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625919.668536:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668543:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743400 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625919.668548:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625919.668552:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845781504:0@lo:104: 00010000:00010000:3.0:1788625919.668556:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625919.668563:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625919.668569:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625919.668608:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668615:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625919.668636:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668658:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4380743400/0x8aede7274cb14795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1479c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.668673:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668674:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625919.668676:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625919.668678:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625919.668700:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845781632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625919.668768:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625919.668837:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781632 00000100:00100000:3.0:1788625919.668842:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781632 00010000:00010000:3.0:1788625919.668861:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 13 pid: 14318 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.668889:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625919.668896:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+13:3311:x1875509845781632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625919.668908:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625919.668913:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 13 pid: 14318 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668924:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 13 pid: 14318 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668937:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb1479c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb14795 expref: 13 pid: 14318 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668950:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668967:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788625919.668980:0:14310:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001926589s 00010000:00010000:3.0:1788625919.668985:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668992:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.668998:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.669004:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.669010:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625919.669014:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.669021:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.669036:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625919.669045:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625919.669054:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.669062:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625919.669068:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4380742e00/0x8aede7274cb147cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625919.669079:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3311:x1875509845781632:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.669085:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625919.669127:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845781632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625919.671713:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14307:x1875509845781376:12345-0@lo:253:mount.lustre.0 Request processed in 71931us (72117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625919.671748:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625919.671813:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14307:1875509845781376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625919.671829:0:14307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788625919.671833:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625919.671835:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625919.671836:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625919.671837:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625919.671839:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625919.671840:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625919.671841:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625919.671842:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625919.671844:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625919.671845:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625919.671857:0:14307:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788625919.675595:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.675716:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625919.676022:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.676152:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625919.676344:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.676701:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625919.677230:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.677347:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625919.677630:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.677966:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625919.678175:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625919.678295:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788625919.692087:0:14307:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788625919.692482:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788625919.692687:0:14360:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788625919.692690:0:14360:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788625919.692916:0:14361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788625919.692966:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625919.694499:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788625919.694640:0:14361:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788625919.694645:0:14361:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788625919.695635:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788625919.695724:0:14307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788625919.696118:0:14307:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788625919.696123:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788625919.696200:0:14307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625919.697146:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788625919.697669:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788625919.697692:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788625919.698776:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788625919.705440:0:14307:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788625919.722512:0:14307:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788625919.722549:0:14307:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdd8c1dcb988 00100000:10000000:1.0:1788625919.722556:0:14307:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788625919.724584:0:14307:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788625919.724602:0:14307:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788625919.724616:0:14307:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788625919.724637:0:14307:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788625920.312097:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625920.628844:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788625920.947820:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625920.947828:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b437996b800 from 6 10000000:01000000:2.0:1788625920.947834:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625920.947882:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625920.947894:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625920.947906:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625920.947945:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845781760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625920.948032:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625920.948080:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4356b54240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625920.948170:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781760 00000100:00100000:3.0:1788625920.948178:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781760 00000100:00100000:3.0:1788625920.948232:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625920.948511:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14322:x1875509845781760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625920.948524:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625920.948538:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb147d4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625920.948562:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625920.948573:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625920.948582:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625920.949091:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845781760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 583us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625920.949098:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625920.954221:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845781760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625920.954252:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625920.954266:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625920.954336:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845781888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788625920.954419:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625920.954505:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43510ee180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625920.955906:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845781888 00000100:00100000:2.0:1788625920.955919:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845781888 00000100:00100000:3.0:1788625920.956018:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625920.956028:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845781888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788625920.956048:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788625920.956064:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788625920.956067:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788625920.956169:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845781888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625920.956184:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625920.956238:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845781888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788625920.956283:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625920.956291:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625920.956300:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625921.330869:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625921.653921:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788625922.356926:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625923.379988:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625924.410443:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625925.121017:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625925.121024:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625925.121027:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625925.121029:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625925.121032:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625925.121034:0:11778:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788625925.121038:0:11778:0:(import.c:65:import_set_state_nolock()) ffff9b4348f91000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625925.121051:0:11778:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b4348f91000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1788625925.121075:0:11778:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43805cd500 x1875509845782144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625925.121120:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625925.121133:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845782016:0@lo:400:kworker.0 00000100:00100000:2.0:1788625925.121200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625925.121262:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782016 00000100:00100000:2.0:1788625925.121270:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782016 00000100:00100000:2.0:1788625925.121338:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625925.121347:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3309:x1875509845782016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625925.121398:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3309:x1875509845782016:12345-0@lo:400:kworker.0 Request processed in 52us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625925.121406:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625925.121459:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845782144:0@lo:38:kworker.0 00000100:00100000:2.0:1788625925.121492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625925.121541:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845782016:0@lo:400:kworker.0 00000100:00100000:0.0:1788625925.133755:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782144 00000100:00100000:0.0:1788625925.133771:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782144 00000100:00100000:0.0:1788625925.133817:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625925.133825:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875509845782144:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788625925.133855:0:14326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1788625925.133889:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8aede7274cb147e2 00000004:00100000:0.0:1788625925.133906:0:14326:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625925.134054:0:14326:0:(import.c:65:import_set_state_nolock()) ffff9b4379ee8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625925.134293:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875509845782144:12345-0@lo:38:kworker.0 Request processed in 466us (12798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625925.134300:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788625925.135184:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b43805cd500 x1875509845782144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625925.135201:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788625925.135208:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788625925.135212:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788625925.135215:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4348f91000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625925.135220:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875509845782144:0@lo:38:kworker.0 00010000:00010000:2.0:1788625925.436073:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625925.957473:0:14604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788625926.450912:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625927.477806:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625928.499198:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625929.205065:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625919/real 1788625919] req@ffff9b43805cea00 x1875509845779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625929.205100:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b43805cea00 x1875509845779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625929.205112:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625919/real 1788625919] req@ffff9b43805cca80 x1875509845779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625929.205237:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b43805cca80 x1875509845779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625929.205270:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625929.205287:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625929.205292:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845779456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788625929.205298:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b436f36b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625929.205317:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625929.205321:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845779328:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788625929.205396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625929.205400:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788625929.205402:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b436f36b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625929.205406:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1788625929.205412:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625929.205418:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b436f36b000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625929.205439:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798cb800 x1875509845782400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625929.205452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625929.205455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625929.205456:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625929.205459:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1788625929.205462:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625929.205466:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625929.205477:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c8000 x1875509845782528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625929.205519:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845782272:0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.205585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625929.205646:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845782656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.205693:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625929.205748:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782272 00000100:00100000:3.0:1788625929.207941:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782272 00000100:00100000:3.0:1788625929.208079:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625929.208090:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3309:x1875509845782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.208185:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3309:x1875509845782272:12345-0@lo:400:kworker.0 Request processed in 97us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625929.208192:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625929.208232:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782656 00000100:00100000:3.0:1788625929.208237:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782656 00000100:00100000:3.0:1788625929.208285:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625929.208295:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845782656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.208335:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845782656:12345-0@lo:400:kworker.0 Request processed in 44us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625929.208342:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788625929.208402:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b43798c8e00 x1875509845782656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625929.208416:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845782656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.208452:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845782272:0@lo:400:kworker.0 00000100:00100000:3.0:1788625929.208473:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845782400:0@lo:8:kworker.0 00000400:00000100:3.0:1788625929.208500:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509845782400 offset 0 length 520: 4 00000100:00100000:3.0:1788625929.208525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845782528:0@lo:8:kworker.0 00000400:00000100:3.0:1788625929.208538:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509845782528 offset 0 length 520: 4 00010000:00010000:3.0:1788625929.523064:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788625930.131960:0:14755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1818b3d0 20000000:00000080:3.0:1788625930.131978:0:14755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b437d437000 uarg=0000000000000000 20000000:01000000:3.0:1788625930.132013:0:14755:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788625930.132021:0:14755:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788625930.132032:0:14755:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788625930.132702:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788625930.134452:0:14755:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788625930.139898:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625930.139929:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.139950:0:14755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.139958:0:14755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.140004:0:14755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.140021:0:14755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 11 pid: 14319 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625930.140269:0:14755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14755:1875509845782784:0@lo:104: 00000100:00100000:3.0:1788625930.140338:0:14755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625930.140434:0:14755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347f6b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625930.140678:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782784 00000100:00100000:1.0:1788625930.140686:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782784 00000100:00100000:2.0:1788625930.140882:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625930.140891:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788625930.140894:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14755:x1875509845782784:12345-0@lo:104: 00000100:00100000:3.0:1788625930.140898:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788625930.140907:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.140964:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625930.140970:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14755:x1875509845782784:12345-0@lo:104: Request processed in 79us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625930.140977:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788625930.140997:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625930.141002:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141010:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:2.0:1788625930.141026:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141034:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625930.141042:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625930.141048:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788625930.141133:0:14755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14755:1875509845782784:0@lo:104: 00010000:00010000:2.0:1788625930.141135:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141141:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625930.141154:0:14755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141160:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141166:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4380743a00/0x8aede7274cb147a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147aa expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625930.141181:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625930.141183:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625930.141185:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625930.141195:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845782912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625930.141218:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625930.141275:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845782912 00000100:00100000:3.0:1788625930.141280:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845782912 00010000:00010000:3.0:1788625930.141298:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 12 pid: 14319 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625930.141344:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625930.141351:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3311:x1875509845782912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625930.141361:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625930.141367:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 12 pid: 14319 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141376:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 12 pid: 14319 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141388:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb147aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb147a3 expref: 12 pid: 14319 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141400:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141407:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141419:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141426:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141432:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141438:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141452:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625930.141456:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141463:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141477:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141486:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625930.141513:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:3311:x1875509845782912:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625930.141520:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788625930.141540:0:14755:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141548:0:14755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625930.141554:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7200/0x8aede7274cb147e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625930.143266:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845782912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625930.548314:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625931.572290:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625931.704464:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625931.704475:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437996b800 from 10 10000000:01000000:1.0:1788625931.704483:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625931.704543:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625931.704556:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625931.704568:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625931.704596:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625931.704668:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625931.704714:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625931.704880:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783040 00000100:00100000:2.0:1788625931.704888:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783040 00000100:00100000:2.0:1788625931.704942:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625931.704961:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+11:14322:x1875509845783040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625931.704974:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625931.704987:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb147f0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625931.705020:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625931.705032:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625931.705042:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94ac00, rc 0) 00000100:00100000:2.0:1788625931.705091:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845783040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625931.705098:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625931.705355:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625931.705371:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625931.705381:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625931.705454:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625931.705482:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625931.705513:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625931.705630:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783168 00000100:00100000:0.0:1788625931.705635:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783168 00000100:00100000:0.0:1788625931.705672:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625931.705681:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845783168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625931.706026:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845783168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625931.706034:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625931.706073:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625931.706106:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625931.706330:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625931.706352:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d9083c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625931.706364:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783296 00000100:00100000:0.0:1788625931.706368:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783296 00000100:00100000:0.0:1788625931.706389:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625931.706396:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845783296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625931.706615:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:14322:x1875509845783296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625931.706623:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625931.706665:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845783296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788625931.708863:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788625931.709015:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788625931.709038:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625931.709050:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625931.709060:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625931.891439:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788625932.596946:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625933.630298:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625934.323857:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845783424:0@lo:400:kworker.0 00000100:00100000:0.0:1788625934.323943:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625934.324082:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783424 00000100:00100000:1.0:1788625934.324096:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783424 00000100:00100000:1.0:1788625934.324152:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625934.324174:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3308:x1875509845783424:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625934.324247:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625934.324252:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625934.324255:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625934.324258:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625934.324618:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845783552:0@lo:400:kworker.0 00000100:00100000:3.0:1788625934.324655:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625934.324699:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783552 00000100:00100000:3.0:1788625934.324710:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783552 00000100:00100000:3.0:1788625934.324757:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625934.324764:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845783552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625934.324803:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845783552:12345-0@lo:400:kworker.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625934.324810:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788625934.324852:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b43805ced80 x1875509845783552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625934.324867:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845783552:0@lo:400:kworker.0 00000100:00100000:1.0:1788625934.325224:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:3308:x1875509845783424:12345-0@lo:400:kworker.0 Request processed in 1062us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625934.325232:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625934.325386:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845783424:0@lo:400:kworker.0 00010000:00010000:3.0:1788625934.644211:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625935.669899:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625935.862163:0:15006:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625935.862167:0:15006:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788625935.862276:0:15006:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b4346657800 00000020:01000004:2.0:1788625935.862290:0:15006:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788625935.862313:0:15006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788625935.862325:0:15006:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b4350f93380) 00000020:00000080:2.0:1788625935.862337:0:15006:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788625935.879625:0:15006:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788625935.884243:0:15006:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788625935.886433:0:15006:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788625935.886811:0:15006:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788625935.887099:0:15006:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788625935.888073:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 691: rc = 0 00100000:10000000:2.0:1788625935.888487:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 691: rc = 0 00100000:10000000:2.0:1788625935.888587:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 691: rc = 0 00100000:10000000:2.0:1788625935.889530:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 528: rc = 0 00100000:10000000:2.0:1788625935.890124:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 528: rc = 0 00100000:10000000:2.0:1788625935.890417:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 528: rc = 0 00100000:10000000:2.0:1788625935.891040:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 528: rc = 0 00100000:10000000:2.0:1788625935.894040:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 528: rc = 0 00100000:10000000:2.0:1788625935.894348:0:15006:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 528: rc = 0 00000020:00000080:2.0:1788625935.894958:0:15006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788625935.894970:0:15006:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788625935.894981:0:15006:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8aede7274cb14805 00000020:01000004:2.0:1788625935.894989:0:15006:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788625935.895010:0:15006:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788625935.895014:0:15006:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788625935.895020:0:15006:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788625935.895031:0:15006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788625935.895042:0:15006:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b4350f919c0) 00000020:00000080:2.0:1788625935.895053:0:15006:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788625935.896288:0:15006:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625935.896455:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788625935.896461:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788625935.902767:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625935.902783:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788625935.903814:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788625935.903835:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788625935.920970:0:15006:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625935.921184:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788625935.921191:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788625935.929539:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788625935.929555:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788625935.960311:0:15006:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625935.960754:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625935.960761:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788625935.977794:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788625935.977907:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788625935.984575:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625935.984593:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788625935.987573:0:15006:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625935.988199:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788625935.988206:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788625935.991139:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788625935.991153:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788625936.079292:0:15006:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625936.079713:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788625936.079721:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788625936.082561:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625936.082577:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788625936.083312:0:15006:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788625936.083337:0:15006:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788625936.083344:0:15006:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788625936.117317:0:15006:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625936.117370:0:15006:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788625936.117375:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625936.117377:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625936.117378:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625936.117379:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625936.117380:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625936.117382:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625936.117383:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625936.117385:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625936.117386:0:15006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625936.117390:0:15006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788625936.117392:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625936.117394:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625936.117395:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625936.117396:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625936.117397:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625936.117405:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625936.117406:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625936.117407:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625936.117408:0:15006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625936.117435:0:15006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788625936.117457:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625936.117529:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.121203:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.121877:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783680 00000100:00100000:2.0:1788625936.121889:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783680 00000100:00100000:2.0:1788625936.121952:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625936.121962:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:15006:x1875509845783680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625936.122023:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788625936.122027:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788625936.122031:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788625936.160859:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:15006:x1875509845783680:12345-0@lo:253:mount.lustre.0 Request processed in 38887us (43318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.160875:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625936.161034:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783680:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788625936.161051:0:15006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788625936.161055:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625936.161056:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625936.161058:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625936.161059:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625936.161060:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625936.161061:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625936.161063:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625936.161065:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625936.161066:0:15006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625936.161088:0:15006:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b4346657800 from lustre-OST0000 10000000:01000000:3.0:1788625936.161114:0:15006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788625936.161117:0:15006:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788625936.161124:0:15006:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b434fce3380 local copy 00010000:00010000:3.0:1788625936.161148:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625936.161402:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625936.161443:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.161482:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.161666:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783808 00000100:00100000:1.0:1788625936.161673:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783808 00000100:00100000:1.0:1788625936.161722:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788625936.161748:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:15006:x1875509845783808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625936.161919:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:15006:x1875509845783808:12345-0@lo:501:mount.lustre.0 Request processed in 189us (475us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625936.161927:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625936.161954:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783808:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788625936.161973:0:15006:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788625936.162162:0:15006:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788625936.162170:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.162180:0:15006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625936.162204:0:15006:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b4346657800 10000000:01000000:0.0:1788625936.162209:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788625936.162214:0:15006:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b434fce3380 10000000:01000000:0.0:1788625936.162217:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788625936.162220:0:15006:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b434fce3380 from 1 10000000:01000000:0.0:1788625936.162223:0:15006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788625936.162249:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.162268:0:15006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.162277:0:15006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625936.162290:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625936.172172:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625936.172232:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.172571:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845783936 00000100:00100000:2.0:1788625936.172580:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845783936 00000100:00100000:2.0:1788625936.172636:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625936.172647:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+12:15006:x1875509845783936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625936.172662:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625936.172683:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94aa00/0x8aede7274cb1481a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14813 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.172756:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94aa00/0x8aede7274cb1481a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14813 expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.172768:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94aa00/0x8aede7274cb1481a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14813 expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.172776:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94aa00, rc 0) 00000100:00100000:0.0:1788625936.176642:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845783936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625936.176675:0:15006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1481a expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.176687:0:15006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1481a expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625936.176712:0:15006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788625936.177194:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1481a expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.177204:0:15006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4380742200/0x8aede7274cb14813 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1481a expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625936.177212:0:15006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788625936.177221:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625936.177228:0:15006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788625936.177230:0:15006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625936.177277:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.177285:0:15006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.177295:0:15006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625936.177315:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625936.177381:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625936.177417:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.177496:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+13:15006:x1875509845783936:12345-0@lo:101:mount.lustre.0 Request processed in 173us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.177508:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625936.177551:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784064 00000100:00100000:2.0:1788625936.177559:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784064 00000100:00100000:2.0:1788625936.177607:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625936.177616:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+13:15006:x1875509845784064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625936.177628:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625936.177641:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94a400/0x8aede7274cb14828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14821 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.177662:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94a400/0x8aede7274cb14828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14821 expref: 14 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.177671:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94a400/0x8aede7274cb14828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14821 expref: 14 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.177680:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a400, rc 0) 00000100:00100000:2.0:1788625936.177715:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784064:12345-0@lo:101:mount.lustre.0 Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.177750:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625936.178599:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625936.178617:0:15006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14828 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.178627:0:15006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14828 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788625936.186848:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788625936.187848:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625936.188143:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788625936.188191:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788625936.188226:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788625936.188272:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788625936.188309:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788625936.188344:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788625936.188407:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788625936.188415:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788625936.188493:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625936.188566:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625936.188621:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.189781:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784192 00000100:00100000:2.0:1788625936.189792:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784192 00000100:00100000:2.0:1788625936.189852:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625936.189863:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625936.190291:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784192:12345-0@lo:501:mount.lustre.0 Request processed in 430us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.190299:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625936.191308:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625936.191360:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625936.191416:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625936.191564:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625936.199872:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784320 00000100:00100000:0.0:1788625936.199889:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784320 00000100:00100000:1.0:1788625936.200055:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625936.200068:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625936.200525:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784320:12345-0@lo:503:mount.lustre.0 Request processed in 459us (9107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.200535:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625936.200579:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625936.201461:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625936.201542:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625936.201610:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.201651:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.201871:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784448 00000100:00100000:2.0:1788625936.201878:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784448 00000100:00100000:2.0:1788625936.201919:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625936.201928:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625936.202228:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784448:12345-0@lo:502:mount.lustre.0 Request processed in 301us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.202235:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788625936.208748:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625936.219189:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788625936.219259:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788625936.219296:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788625936.219346:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788625936.219381:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788625936.219415:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788625936.219545:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788625936.219585:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788625936.219622:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788625936.219670:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788625936.219708:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788625936.220072:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788625936.220136:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625936.220229:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625936.220518:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.221032:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784576 00000100:00100000:1.0:1788625936.221041:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784576 00000100:00100000:1.0:1788625936.221093:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625936.221103:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625936.221384:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784576:12345-0@lo:502:mount.lustre.0 Request processed in 282us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.221393:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788625936.225311:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625936.225602:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788625936.225617:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788625936.226692:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625936.226706:0:15020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788625936.226714:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.226717:0:15020:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788625936.226722:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625936.226781:0:15020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b437a5d8000) 00000020:00000080:0.0:1788625936.226810:0:15020:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788625936.226816:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625936.226895:0:15020:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b4346657800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788625936.226902:0:15020:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625936.226915:0:15020:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8aede7274cb14836 00010000:00010000:2.0:1788625936.237150:0:15020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788625936.237572:0:15020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788625936.239108:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788625936.255664:0:15020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788625936.255679:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625936.255686:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.255688:0:15020:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788625936.255692:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625936.255696:0:15020:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788625936.255697:0:15020:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625936.255699:0:15020:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625936.255700:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625936.255703:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.255704:0:15020:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625936.255706:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625936.255709:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.255711:0:15020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788625936.255713:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788625936.255716:0:15020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788625936.255718:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625936.255720:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.255721:0:15020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788625936.255723:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625936.255928:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.255930:0:15020:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788625936.255937:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788625936.256002:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625936.256006:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625936.256008:0:15020:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788625936.256011:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788625936.264084:0:15006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788625936.264141:0:15006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788625936.264167:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14828 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625936.264180:0:15006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4380742800/0x8aede7274cb14821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14828 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625936.265067:0:15006:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346657800 from 1 10000000:01000000:3.0:1788625936.265089:0:15006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625936.265142:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.265151:0:15006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.265162:0:15006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625936.265188:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625936.265260:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.265307:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.265361:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784704 00000100:00100000:1.0:1788625936.265369:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784704 00000100:00100000:1.0:1788625936.265418:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788625936.265428:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+14:15006:x1875509845784704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625936.265439:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625936.265467:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1483d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.265490:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1483d expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.265501:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1483d expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.265510:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4ca00, rc 0) 00000100:00100000:1.0:1788625936.265559:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845784704:12345-0@lo:101:mount.lustre.0 Request processed in 133us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.265566:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625936.265645:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625936.265660:0:15006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.265668:0:15006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625936.266224:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788625936.266751:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625936.266961:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788625936.266998:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788625936.267051:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788625936.267058:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788625936.267109:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625936.267164:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625936.267206:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784832 00000100:00100000:0.0:1788625936.267211:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784832 00000100:00100000:0.0:1788625936.267239:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625936.267248:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845784832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625936.267418:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845784832:12345-0@lo:501:mount.lustre.0 Request processed in 171us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625936.267426:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625936.267458:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625936.267474:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625936.267499:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625936.267535:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625936.267566:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625936.268639:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845784960 00000100:00100000:3.0:1788625936.268648:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845784960 00000100:00100000:3.0:1788625936.268680:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625936.268688:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845784960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625936.269056:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845784960:12345-0@lo:503:mount.lustre.0 Request processed in 368us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625936.269063:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625936.269223:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845784960:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625936.270099:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625936.270184:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625936.270243:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625936.270275:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.270375:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785088 00000100:00100000:1.0:1788625936.270382:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785088 00000100:00100000:1.0:1788625936.270419:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788625936.270428:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845785088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625936.270615:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845785088:12345-0@lo:502:mount.lustre.0 Request processed in 187us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.270622:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625936.273641:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625936.274040:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788625936.274110:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788625936.274196:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788625936.274235:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788625936.274267:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788625936.274333:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788625936.274380:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788625936.276293:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788625936.276383:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625936.278330:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625936.278378:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435729e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625936.278531:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785216 00000100:00100000:0.0:1788625936.278541:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785216 00000100:00100000:0.0:1788625936.278614:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625936.278625:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845785216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625936.278880:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845785216:12345-0@lo:502:mount.lustre.0 Request processed in 256us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625936.278889:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625936.279228:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625936.279376:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788625936.279390:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788625936.280266:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625936.280276:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.280278:0:15024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625936.280284:0:15024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4346657800 00000020:00000080:0.0:1788625936.280287:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625936.280294:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625936.280296:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.280298:0:15024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788625936.280300:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625936.280302:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.280304:0:15024:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625936.280307:0:15024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b4346657800 00000020:00000080:0.0:1788625936.280309:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625936.280572:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625936.280576:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.280578:0:15024:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788625936.280580:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625936.280589:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.280591:0:15024:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625936.280595:0:15024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b4346657800 00000020:00000080:0.0:1788625936.280598:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625936.294968:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625936.294982:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625936.294984:0:15024:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788625936.294990:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788625936.297833:0:15006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788625936.297873:0:15006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625936.297896:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.297909:0:15006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625936.297955:0:15006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788625936.297964:0:15006:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b4346657800 10000000:01000000:3.0:1788625936.297967:0:15006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b4346657800 10000000:01000000:3.0:1788625936.297970:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625936.297977:0:15006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b4346657800 from 1 10000000:01000000:3.0:1788625936.297979:0:15006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625936.298016:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.298026:0:15006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.298037:0:15006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625936.298062:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625936.298138:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.298177:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625936.300058:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785344 00000100:00100000:0.0:1788625936.300071:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785344 00000100:00100000:0.0:1788625936.300134:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625936.300145:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845785344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625936.300162:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625936.300182:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4380743600/0x8aede7274cb14852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1484b expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.300208:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4380743600/0x8aede7274cb14852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1484b expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.300219:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4380743600/0x8aede7274cb14852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1484b expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625936.300228:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743600, rc 0) 00000100:00100000:0.0:1788625936.300298:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785344:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625936.300304:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625936.300314:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625936.300330:0:15006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14852 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.300339:0:15006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14852 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625936.305260:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788625936.305893:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625936.313508:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788625936.313597:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788625936.313626:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788625936.313671:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788625936.313719:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788625936.313790:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788625936.313843:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788625936.313873:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788625936.313916:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788625936.313950:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788625936.313983:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788625936.314032:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788625936.314087:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788625936.314119:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788625936.314192:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788625936.314227:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788625936.314253:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788625936.314290:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788625936.314320:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788625936.316794:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788625936.316934:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788625936.316981:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788625936.317037:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788625936.317103:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788625936.317152:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788625936.317186:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788625936.317234:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788625936.317272:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788625936.317362:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788625936.317369:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788625936.321530:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625936.322757:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.322809:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625936.323576:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785472 00000100:00100000:0.0:1788625936.323587:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785472 00000100:00100000:0.0:1788625936.323660:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625936.323672:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625936.324161:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785472:12345-0@lo:501:mount.lustre.0 Request processed in 489us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625936.324169:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625936.326262:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625936.326348:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625936.326437:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.326697:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.330859:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785600 00000100:00100000:1.0:1788625936.330874:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785600 00000100:00100000:1.0:1788625936.330935:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788625936.330954:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625936.331228:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785600:12345-0@lo:503:mount.lustre.0 Request processed in 283us (4790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.331236:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625936.333430:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625936.334934:0:15006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625936.335039:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625936.335116:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.335176:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625936.335553:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785728 00000100:00100000:1.0:1788625936.335566:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785728 00000100:00100000:1.0:1788625936.335715:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625936.335725:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625936.336191:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785728:12345-0@lo:502:mount.lustre.0 Request processed in 466us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.336199:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625936.336718:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788625936.337309:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788625936.337393:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788625936.337440:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788625936.337505:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788625936.337547:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788625936.337593:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788625936.337630:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788625936.337680:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788625936.337759:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788625936.337799:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788625936.337834:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788625936.337884:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788625936.337918:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788625936.338148:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788625936.338228:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788625936.338270:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788625936.338304:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788625936.338425:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788625936.338472:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788625936.338506:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788625936.338560:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788625936.338598:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788625936.338635:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788625936.338799:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788625936.338840:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788625936.338887:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788625936.338938:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788625936.339855:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788625936.339898:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788625936.340467:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788625936.340528:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788625936.340566:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788625936.340603:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788625936.341533:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788625936.341588:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788625936.341640:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788625936.341872:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788625936.341910:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788625936.342047:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788625936.342083:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788625936.342151:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625936.342236:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625936.342286:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625936.347040:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785856 00000100:00100000:2.0:1788625936.347053:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785856 00000100:00100000:2.0:1788625936.347114:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788625936.347136:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625936.347438:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845785856:12345-0@lo:502:mount.lustre.0 Request processed in 314us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.347458:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788625936.347491:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845785856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788625936.347609:0:15006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788625936.347625:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788625936.349615:0:15029:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788625936.349635:0:15029:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b437a5d99c0) 00000020:00000080:0.0:1788625936.349668:0:15029:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788625936.349767:0:15029:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b4346657800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788625936.349772:0:15029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b4346657800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788625936.349774:0:15029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b4346657800 3 00010000:00080000:0.0:1788625936.349806:0:15029:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b4351a34800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1788625936.351484:0:15029:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788625936.351693:0:15029:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788625936.351748:0:15029:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625936.351764:0:15029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8aede7274cb14860 00000100:00080000:0.0:1788625936.351777:0:15029:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625936.351783:0:15029:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b4351a34800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625936.351832:0:15029:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b4345f3dc00 x1875509845785984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625936.351857:0:15029:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788625936.352431:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845785984:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625936.352504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625936.353087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625936.353093:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625936.353096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625936.353099:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625936.353161:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845786112:0@lo:400:kworker.0 00000100:00100000:3.0:1788625936.353194:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625936.353238:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845785984 00000100:00100000:3.0:1788625936.353245:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845785984 00000100:00100000:3.0:1788625936.353270:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786112 00000100:00100000:3.0:1788625936.353272:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786112 00000100:00100000:3.0:1788625936.353297:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625936.353305:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625936.353363:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845786112:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625936.353371:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625936.353387:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625936.353399:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875509845785984:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788625936.353406:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b43798ca680 x1875509845786112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788625936.353419:0:14325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000100:00100000:1.0:1788625936.353428:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845786112:0@lo:400:kworker.0 00000020:00000080:3.0:1788625936.353461:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8aede7274cb14867 00000004:00100000:3.0:1788625936.353475:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625936.353508:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9b434860d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625936.353555:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875509845785984:12345-0@lo:38:llog_process_th.0 Request processed in 155us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625936.353561:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788625936.356907:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b4345f3dc00 x1875509845785984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625936.356938:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625936.356959:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788625936.356969:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788625936.356974:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625936.356977:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4351a34800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625936.356984:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875509845785984:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788625936.357200:0:15029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788625936.357375:0:15006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788625936.357405:0:15006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625936.357437:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14852 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.357449:0:15006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f7400/0x8aede7274cb1484b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14852 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788625936.357494:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788625936.357496:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625936.357497:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625936.357499:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625936.357500:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625936.357502:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625936.357503:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625936.357505:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625936.357507:0:15006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788625936.357511:0:15006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788625936.357514:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788625936.357515:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625936.357516:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625936.357517:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625936.357518:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625936.357519:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625936.357520:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625936.357525:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625936.357526:0:15006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788625936.357553:0:15006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788625936.357572:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845786240:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788625936.357865:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625936.357912:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625936.357923:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786240 00000100:00100000:3.0:1788625936.357930:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786240 00000100:00100000:3.0:1788625936.357977:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625936.357987:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15006:x1875509845786240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625936.358017:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788625936.358031:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788625936.421619:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788625936.421645:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788625936.421690:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788625936.421697:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788625936.421723:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.421817:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.421828:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.423076:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.423097:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 16 pid: 14319 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625936.423139:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845786368:0@lo:104: 00000100:00100000:2.0:1788625936.423307:0:14340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625936.423364:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350f64000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625936.424108:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786368 00000100:00100000:3.0:1788625936.424118:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786368 00000100:00100000:3.0:1788625936.424181:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625936.424190:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845786368:12345-0@lo:104: 00010000:00010000:3.0:1788625936.424205:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.424282:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625936.424289:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845786368:12345-0@lo:104: Request processed in 100us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625936.424295:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788625936.424330:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625936.424339:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424348:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94bc00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625936.424353:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424372:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625936.424380:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625936.424386:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845786368:0@lo:104: 10000000:01000000:1.0:1788625936.424389:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625936.424414:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424432:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424440:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625936.424473:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424480:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b434f94bc00/0x8aede7274cb147d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147db expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424523:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625936.424525:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625936.424526:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625936.424538:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845786496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625936.424573:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625936.424764:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786496 00000100:00100000:1.0:1788625936.424768:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786496 00010000:00010000:1.0:1788625936.424789:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 17 pid: 14319 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625936.424829:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625936.424838:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:3311:x1875509845786496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625936.424849:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625936.424854:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 17 pid: 14319 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424865:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 17 pid: 14319 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424880:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb147db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb147d4 expref: 17 pid: 14319 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424894:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424902:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625936.424916:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003219560s 00010000:00010000:1.0:1788625936.424921:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424939:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424946:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424953:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424958:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625936.424963:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424970:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.424990:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625936.425000:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625936.425034:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3311:x1875509845786496:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625936.425041:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625936.425070:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845786496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625936.425121:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.425142:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625936.425149:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f6c00/0x8aede7274cb1486e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625936.445451:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:15006:x1875509845786240:12345-0@lo:253:mount.lustre.0 Request processed in 87456us (87576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625936.445466:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625936.448430:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15006:1875509845786240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788625936.448460:0:15006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788625936.448464:0:15006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625936.448466:0:15006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788625936.448483:0:15006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625936.448485:0:15006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625936.448486:0:15006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625936.448487:0:15006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625936.448489:0:15006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625936.448491:0:15006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625936.448492:0:15006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788625936.448513:0:15006:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788625936.462869:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788625936.463074:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788625936.464592:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788625936.464818:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788625936.469398:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788625936.469793:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788625936.471968:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788625936.596709:0:15006:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788625936.596719:0:15006:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788625936.597255:0:15006:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625936.597324:0:15006:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625936.597344:0:15006:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788625936.597377:0:15006:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788625936.691984:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625937.715063:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788625938.294435:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625938.294443:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b437996b800 from 7 10000000:01000000:2.0:1788625938.294448:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625938.294499:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625938.294520:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625938.294557:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625938.294587:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845786624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625938.294673:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625938.295073:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b436ea5cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625938.301373:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786624 00000100:00100000:0.0:1788625938.301397:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786624 00000100:00100000:0.0:1788625938.301471:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788625938.301484:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+15:14322:x1875509845786624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625938.301503:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625938.301534:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14875 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625938.303159:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14875 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625938.303174:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14875 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625938.303184:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380742000, rc 0) 00000100:00100000:0.0:1788625938.303274:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:14322:x1875509845786624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1792us (8600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625938.303282:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625938.305070:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845786624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625938.305110:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625938.305123:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625938.305205:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845786752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788625938.305274:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625938.305323:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625938.305559:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786752 00000100:00100000:2.0:1788625938.305567:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786752 00000100:00100000:2.0:1788625938.305620:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625938.305632:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:14322:x1875509845786752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788625938.305909:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788625938.306001:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788625938.306004:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788625938.306145:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:14322:x1875509845786752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 513us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625938.306154:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625938.306202:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845786752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788625938.306267:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625938.306276:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625938.306287:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625938.748224:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625939.762853:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625940.787822:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625941.108365:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788625941.497863:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625941.497874:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625941.497877:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625941.497895:0:11778:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625941.497997:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845787008:0@lo:400:kworker.0 00000100:00100000:3.0:1788625941.498086:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625941.498143:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625941.498151:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845786880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625941.498181:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625941.498216:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845787136:0@lo:400:kworker.0 00000100:00100000:3.0:1788625941.498245:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625941.498294:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787008 00000100:00100000:3.0:1788625941.498301:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787008 00000100:00100000:3.0:1788625941.498344:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787136 00000100:00100000:3.0:1788625941.498347:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787136 00000100:00100000:3.0:1788625941.498395:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625941.498404:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845787008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625941.498410:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625941.498467:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845787008:12345-0@lo:400:kworker.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625941.498475:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625941.501350:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625941.501504:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845787136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625941.501761:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875509845787136:12345-0@lo:400:kworker.0 Request processed in 397us (3512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625941.501770:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625941.501809:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845786880 00000100:00100000:3.0:1788625941.501817:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845786880 00000100:00100000:3.0:1788625941.501856:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625941.501864:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3309:x1875509845786880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625941.501907:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3309:x1875509845786880:12345-0@lo:400:kworker.0 Request processed in 44us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625941.501912:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625941.501968:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845786880:0@lo:400:kworker.0 00010000:00080000:3.0:1788625941.501985:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798c8380 x1875509845787008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625941.501997:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845787008:0@lo:400:kworker.0 00010000:00080000:3.0:1788625941.502045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798c9500 x1875509845787136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625941.502056:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875509845787136:0@lo:400:kworker.0 00010000:00010000:2.0:1788625941.811071:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625942.838201:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625943.859899:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625944.197477:0:15373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788625944.562899:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625929/real 1788625929] req@ffff9b43798cb800 x1875509845782400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625944 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625944.562936:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b43798cb800 x1875509845782400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625944 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625944.562947:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625929/real 1788625929] req@ffff9b43798c8000 x1875509845782528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625944 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625944.562958:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b43798c8000 x1875509845782528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625944 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625944.562979:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b436f36b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625944.563079:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788625944.563083:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845782400:0@lo:8:kworker.0 00000100:00080000:2.0:1788625944.563090:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625944.563095:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788625944.563097:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845782528:0@lo:8:kworker.0 00000100:00080000:3.0:1788625944.563199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625944.563204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788625944.563207:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b436f36b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625944.563213:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:3.0:1788625944.563226:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625944.563234:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b436f36b000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625944.563255:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c8380 x1875509845787392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625944.563276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625944.563279:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625944.563281:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625944.563284:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:3.0:1788625944.563312:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625944.563316:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625944.563329:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c8a80 x1875509845787520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625944.563483:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845787392:0@lo:8:kworker.0 00000100:00100000:2.0:1788625944.563551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625944.563603:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845787520:0@lo:8:kworker.0 00000100:00100000:2.0:1788625944.563627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625944.563666:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788625944.563703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625944.563768:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625944.563780:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3310:1875509845787264:0@lo:400:kworker.0 00000100:00100000:0.0:1788625944.563829:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625944.563874:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787264 00000100:00100000:0.0:1788625944.563882:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787264 00000100:00100000:3.0:1788625944.567793:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625944.567813:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845787776:0@lo:400:kworker.0 00000100:00100000:3.0:1788625944.567875:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625944.567920:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787648 00000100:00100000:3.0:1788625944.567928:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787648 00000100:00100000:3.0:1788625944.567972:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787776 00000100:00100000:3.0:1788625944.567975:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787776 00000100:00100000:3.0:1788625944.568022:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625944.568030:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625944.568102:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845787648:12345-0@lo:400:kworker.0 Request processed in 57us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625944.568110:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625944.568128:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625944.568134:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845787776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625944.568161:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845787776:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625944.568167:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788625944.568188:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625944.568567:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798ca300 x1875509845787776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625944.568605:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845787776:0@lo:400:kworker.0 00010000:00080000:3.0:1788625944.568621:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798cb480 x1875509845787648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625944.568630:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845787648:0@lo:400:kworker.0 00000100:00100000:0.0:1788625944.568754:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625944.568766:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3310:x1875509845787264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625944.568805:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787392 00000100:00100000:1.0:1788625944.568812:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787392 00000100:00100000:1.0:1788625944.568844:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787520 00000100:00100000:1.0:1788625944.568849:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787520 00000100:00100000:1.0:1788625944.568864:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625944.568871:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875509845787392:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788625944.568878:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3310:x1875509845787264:12345-0@lo:400:kworker.0 Request processed in 115us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625944.568886:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788625944.568901:0:15009:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000100:00100000:0.0:1788625944.568942:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3310:1875509845787264:0@lo:400:kworker.0 00000020:00000080:1.0:1788625944.568946:0:15009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb14883 00002000:00100000:1.0:1788625944.569093:0:15009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b43583de800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788625944.569104:0:15009:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788625944.569107:0:15009:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788625944.570626:0:15009:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788625944.570657:0:15009:0:(import.c:65:import_set_state_nolock()) ffff9b43583dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625944.570749:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875509845787392:12345-0@lo:8:kworker.0 Request processed in 1876us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625944.570758:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625944.570785:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625944.570791:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875509845787520:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788625944.570806:0:15009:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788625944.570832:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875509845787520:12345-0@lo:8:kworker.0 Request processed in 40us (7204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788625944.570838:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625944.571526:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798c8380 x1875509845787392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625944.571539:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625944.571549:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788625944.571558:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788625944.571564:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788625944.571566:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b436f36b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788625944.571592:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788625944.571597:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845787392:0@lo:8:kworker.0 00000100:00080000:0.0:1788625944.571615:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625944.571620:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788625944.571623:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845787520:0@lo:8:kworker.0 00000004:00080000:3.0:1788625944.571709:0:14346:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788625944.572053:0:14346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494568323558ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788625944.572523:0:14347:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788625944.572546:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1875509845788032:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788625944.572580:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625944.572595:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845787904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625944.572606:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625944.572637:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435728b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625944.572655:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788032 00000100:00100000:1.0:1788625944.572661:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788032 00000100:00100000:3.0:1788625944.572676:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625944.572713:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625944.572755:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845787904 00000100:00100000:3.0:1788625944.572760:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845787904 00000100:00100000:1.0:1788625944.572852:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625944.572854:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625944.572864:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14347:x1875509845788032:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788625944.572868:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845787904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625944.572897:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625944.572952:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875509845787904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625944.572960:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788625944.573092:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43801fb800 x1875509845787904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625944.573109:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845787904:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788625944.596238:0:15009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788625944.596251:0:15009:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788625944.596256:0:15009:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788625944.620937:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.620953:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.620978:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.620992:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.621001:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621021:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621032:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621042:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621061:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788625944.621511:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.621518:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621527:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.621531:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.621536:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621547:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621567:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621575:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.621590:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788625944.622388:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.622395:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.622405:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.622409:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.622413:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.622423:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.622431:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.622438:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.622458:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788625944.624381:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.624391:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.624404:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.624408:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.624413:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.624425:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.624434:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.624442:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.624454:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788625944.627341:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.627356:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.627373:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.627384:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.627390:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.627405:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.627415:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.627424:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.627435:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788625944.628212:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.628219:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.628230:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.628235:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.628240:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.628251:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.628260:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.628274:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.628283:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788625944.628607:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788625944.628616:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628625:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4de00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.628630:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628641:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628667:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628676:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb1488a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628698:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788625944.628702:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628707:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.628710:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628749:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628760:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.628768:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb599ee7/0x8aede7274cb14891 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629011:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788625944.629018:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629034:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.629038:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629046:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629058:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629066:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000517c4168/0x8aede7274cb14898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629081:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625944.629085:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629091:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.629094:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629102:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629111:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629125:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed17dd8/0x8aede7274cb1489f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629138:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625944.629142:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629149:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.629152:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629159:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629168:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629175:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069172f61/0x8aede7274cb148a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629185:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625944.629189:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629196:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.629203:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629211:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629219:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629226:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb148ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.629238:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.629240:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.629242:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.630652:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.630664:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.630679:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.630683:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.630689:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.630702:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.630712:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.630748:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.630769:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625944.631053:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625944.631060:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.631069:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.631074:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.631084:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.631100:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.631117:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d7e120/0x8aede7274cb148b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.631138:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.631140:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.631142:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.632005:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.634168:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.634182:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634205:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.634209:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.634216:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634231:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634243:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634251:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634279:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788625944.634773:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.634779:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634788:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.634791:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.634796:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634805:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634824:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634831:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.634849:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788625944.636175:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.636185:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.636198:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.636201:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.636207:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.636219:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.636227:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.636234:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.636254:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788625944.637060:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.637068:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.637078:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.637081:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.637086:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.637097:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.637106:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.637114:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.637124:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788625944.637148:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788625944.637158:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637168:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.637173:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637194:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637216:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637225:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb148bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637252:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625944.637256:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637264:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.637267:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637275:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637286:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637294:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004105d46d/0x8aede7274cb148c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637325:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625944.637329:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637336:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.637339:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637346:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637357:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637364:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05441ce/0x8aede7274cb148c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637391:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.637395:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637401:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4dc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.637405:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637500:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637512:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637519:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f3bf67/0x8aede7274cb148d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.637533:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.637534:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.637536:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.638437:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.639168:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.639179:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.639195:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.639205:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.639212:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.639228:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.639240:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.639249:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.639275:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625944.640536:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.640549:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.640563:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.640569:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.640579:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.640604:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625944.640623:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788625944.640626:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f7fc013/0x8aede7274cb148d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.640633:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.640645:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.640649:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625944.640650:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.640654:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.640655:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.640656:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.640669:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.640678:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.640692:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.640933:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625944.641619:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.641627:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.641637:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.641642:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.641651:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.641665:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.641674:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d9222c/0x8aede7274cb148de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.641693:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.641695:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.641696:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.642326:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.642335:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.642346:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.642351:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.642356:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.642368:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.642377:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.642385:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.642410:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625944.644909:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.644921:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.644935:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.644941:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.644952:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.644973:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.644991:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b256c2e1/0x8aede7274cb148e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.645012:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.645014:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.645016:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.646251:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.646263:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.646284:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.646289:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.646297:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.646312:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.646323:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.646332:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.646349:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625944.646550:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.646557:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.646565:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.646569:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.646590:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.646605:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.646614:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000771d73e6/0x8aede7274cb148ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.646631:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.646633:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.646635:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625944.654703:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.654949:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.654968:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.654973:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.654989:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655006:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655029:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655038:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655100:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788625944.655690:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788625944.655697:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655707:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788625944.655710:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625944.655815:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655829:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655837:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.655845:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659458:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625944.659486:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659501:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.659507:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659519:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659543:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659565:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09be827/0x8aede7274cb148f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659599:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.659603:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659609:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.659613:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659621:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659631:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.659638:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.659640:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.659642:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.661249:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788625944.661263:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebbc7c6/0x8aede7274cb148fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.661357:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.664611:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.664624:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.664640:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.664645:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.664652:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.664668:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.664678:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.664686:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.664709:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625944.664809:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625944.664819:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.664829:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625944.664835:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.664847:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.664876:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.664885:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2038bb7/0x8aede7274cb14901 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.664908:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.664911:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.664914:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.665157:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.665164:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665172:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.665174:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.665178:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665188:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665195:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665201:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665224:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625944.665660:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.665667:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665674:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.665677:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.665681:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665702:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665710:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665718:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665753:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788625944.665776:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625944.665781:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665788:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.665792:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665799:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665811:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665819:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14908 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665842:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625944.665845:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665851:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.665853:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665860:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665868:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665874:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb1490f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.665883:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.665884:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.665886:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.666354:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.666361:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666367:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.666371:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.666374:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.666392:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666403:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666411:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666418:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666439:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625944.666673:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625944.666680:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666688:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625944.666692:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666701:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666723:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666756:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b95bc2d/0x8aede7274cb14916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666778:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.666781:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.666783:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.666868:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.666874:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666883:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.666886:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.666889:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666898:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666906:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666923:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.666944:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625944.666969:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625944.666975:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.666993:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625944.666996:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.667018:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.667029:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.667037:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ed9cec6/0x8aede7274cb1491d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.667051:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.667053:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.667055:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.678962:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.678989:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679006:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.679012:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.679019:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679035:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679048:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679056:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625944.679075:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788625944.679113:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625944.679124:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625944.679130:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679146:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625944.679150:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679160:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679177:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679185:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a830a3/0x8aede7274cb14924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.679204:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.679206:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.679208:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.682279:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.682292:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.682308:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.682312:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.682319:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.682333:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.682350:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.682357:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.682373:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625944.682530:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625944.682541:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.682553:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625944.682559:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.682571:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.682589:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.682609:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065369629/0x8aede7274cb1492b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625944.682629:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.682632:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625944.682633:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625944.685356:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.685369:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.686533:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.686538:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.686547:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.686566:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.686579:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.686587:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.686635:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625944.688341:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.688352:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.688368:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.688372:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625944.688614:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.688624:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.688633:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.688645:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.688656:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.688676:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.688683:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fca28da/0x8aede7274cb14932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.688703:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.688704:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.688706:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.689026:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689041:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689051:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689059:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689126:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625944.689643:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625944.689650:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689659:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1788625944.689668:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625944.689672:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689682:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689690:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625944.689696:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.696834:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625944.696852:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.696867:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.696872:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.696883:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.696905:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.696921:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ba95c8/0x8aede7274cb14939 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.697304:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625944.697311:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.697319:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625944.697322:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.697330:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.697342:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625944.697349:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.697351:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625944.697354:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625944.699988:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625944.700002:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3b97e3/0x8aede7274cb14940 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788625944.704115:0:15009:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788625944.704232:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14347:x1875509845788032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 131364us (131619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625944.704245:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625944.704306:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1875509845788032:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788625944.704322:0:14347:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788625944.704372:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1875509845788160:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788625944.704417:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625944.704463:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351a03000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625944.704492:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788160 00000100:00100000:0.0:1788625944.704499:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788160 00000100:00100000:0.0:1788625944.704537:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625944.704546:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14347:x1875509845788160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788625944.704583:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788625944.712495:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625944.732485:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14347:x1875509845788160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27932us (28059us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788625944.732497:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625944.733819:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1875509845788160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788625944.733837:0:14347:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788625944.882902:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625945.910356:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788625946.712244:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788625946.712301:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788625946.931143:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625947.955043:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625948.980211:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625949.683011:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845788288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625949.683104:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625949.683224:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788288 00000100:00100000:2.0:1788625949.683243:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788288 00000100:00100000:2.0:1788625949.683307:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625949.683317:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845788288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625949.683353:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625949.683402:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845788288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625949.683408:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625949.683461:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788625949.683484:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845788288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625949.683803:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625949.684533:0:11778:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625949.684539:0:11778:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625949.684543:0:11778:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625949.684549:0:11778:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1788625949.684553:0:11778:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788625949.684559:0:11778:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625949.684580:0:11778:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b4345f3d880 x1875509845788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625949.684622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845788672:0@lo:400:kworker.0 00000100:00100000:0.0:1788625949.684665:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625949.684688:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625949.684703:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845788416:0@lo:400:kworker.0 00000100:00100000:0.0:1788625949.684756:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625949.684784:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845788544:0@lo:8:kworker.0 00000100:00100000:0.0:1788625949.684808:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625949.684831:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625949.684837:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845788800:0@lo:400:kworker.0 00000100:00100000:0.0:1788625949.684860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625949.684884:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788544 00000100:00100000:0.0:1788625949.684890:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788544 00000100:00100000:0.0:1788625949.684937:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625949.684945:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875509845788544:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788625949.684964:0:15007:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625949.685112:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788672 00000100:00100000:3.0:1788625949.685117:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788672 00000100:00100000:3.0:1788625949.685153:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788800 00000100:00100000:3.0:1788625949.685156:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788800 00000100:00100000:3.0:1788625949.685180:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625949.685186:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845788672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625949.685245:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875509845788672:12345-0@lo:400:kworker.0 Request processed in 59us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625949.685252:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625949.685266:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625949.685272:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845788800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625949.685301:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845788800:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625949.685307:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625949.685324:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788416 00000100:00100000:3.0:1788625949.685327:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788416 00000100:00100000:3.0:1788625949.685349:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788625949.685355:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3309:x1875509845788416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625949.685382:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3309:x1875509845788416:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625949.685389:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788625949.685420:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625949.685443:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4345f3fb80 x1875509845788800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625949.685455:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845788800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625949.685478:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845788416:0@lo:400:kworker.0 00010000:00080000:3.0:1788625949.685487:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b4345f3f100 x1875509845788672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625949.685508:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875509845788672:0@lo:400:kworker.0 00000100:00100000:0.0:1788625949.732356:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875509845788544:12345-0@lo:8:kworker.0 Request processed in 47399us (47535us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788625949.732371:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788625949.732588:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625949.732594:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788625949.732599:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845788544:0@lo:8:kworker.0 00010000:00010000:3.0:1788625950.010931:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625951.031082:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625951.347615:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788625951.773501:0:15726:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788625951.773505:0:15726:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788625951.773644:0:15726:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b43583db800 00000020:01000004:1.0:1788625951.773810:0:15726:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788625951.773824:0:15726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788625951.773839:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b437978b380) 00000020:00000080:1.0:1788625951.773854:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788625951.789530:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788625951.789911:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788625951.790550:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788625951.790942:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788625951.791222:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788625951.791536:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 675: rc = 0 00100000:10000000:1.0:1788625951.791597:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 675: rc = 0 00100000:10000000:1.0:1788625951.791868:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 675: rc = 0 00100000:10000000:1.0:1788625951.792367:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 818: rc = 0 00100000:10000000:1.0:1788625951.792601:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 818: rc = 0 00100000:10000000:2.0:1788625951.793232:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 818: rc = 0 00100000:10000000:2.0:1788625951.793561:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 818: rc = 0 00100000:10000000:2.0:1788625951.794084:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 818: rc = 0 00100000:10000000:2.0:1788625951.794411:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 818: rc = 0 00000020:00000080:2.0:1788625951.795501:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788625951.795513:0:15726:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788625951.795524:0:15726:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8aede7274cb1494e 00000020:01000004:2.0:1788625951.795533:0:15726:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788625951.795553:0:15726:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788625951.795556:0:15726:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788625951.795563:0:15726:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788625951.795586:0:15726:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788625951.795591:0:15726:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788625951.804852:0:15726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625951.804904:0:15726:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788625951.804909:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625951.804911:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788625951.804912:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625951.804914:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625951.804915:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625951.804916:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625951.804918:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625951.804920:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625951.804921:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625951.804925:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788625951.804927:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625951.804928:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788625951.804929:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625951.804930:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625951.804932:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625951.804933:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625951.804933:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625951.804934:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625951.804935:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625951.804964:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788625951.804986:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845788928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625951.805060:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.805241:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625951.805284:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845788928 00000100:00100000:0.0:1788625951.805291:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845788928 00000100:00100000:0.0:1788625951.805360:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625951.805368:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15726:x1875509845788928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788625951.805393:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788625951.805395:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788625951.805399:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788625951.811974:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15726:x1875509845788928:12345-0@lo:253:mount.lustre.0 Request processed in 6597us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.811990:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625951.812148:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845788928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625951.812167:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788625951.812170:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625951.812172:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625951.812174:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625951.812182:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625951.812183:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625951.812184:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625951.812186:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625951.812188:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625951.812189:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788625951.812215:0:15726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b43583db800 from lustre-OST0001 10000000:01000000:0.0:1788625951.812239:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788625951.812242:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788625951.812249:0:15726:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b434fce3380 local copy 00010000:00010000:0.0:1788625951.812261:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625951.812548:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625951.812587:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625951.812675:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.812873:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789056 00000100:00100000:3.0:1788625951.812881:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789056 00000100:00100000:3.0:1788625951.812931:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788625951.812941:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15726:x1875509845789056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.813210:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15726:x1875509845789056:12345-0@lo:501:mount.lustre.0 Request processed in 269us (621us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625951.813217:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788625951.813360:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788625951.813377:0:15726:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788625951.813547:0:15726:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788625951.813555:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.813564:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6800/0x8aede7274cb146fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14702 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625951.813586:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b43583db800 10000000:01000000:1.0:1788625951.813591:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788625951.813596:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788625951.813599:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625951.813603:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788625951.813606:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788625951.813633:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.813642:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.813651:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625951.813679:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625951.813708:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.813748:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.813902:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789184 00000100:00100000:3.0:1788625951.813906:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789184 00000100:00100000:3.0:1788625951.813938:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788625951.813945:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:15726:x1875509845789184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625951.813955:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625951.813968:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1495c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14955 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.813988:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1495c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14955 expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.813998:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7e00/0x8aede7274cb1495c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14955 expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.814008:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7e00, rc 0) 00000100:00100000:3.0:1788625951.814036:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789184:12345-0@lo:101:mount.lustre.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.814040:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625951.814175:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625951.814191:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1495c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.814197:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb1495c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788625951.814654:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788625951.815580:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625951.815974:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788625951.816016:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788625951.816050:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788625951.816104:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788625951.816127:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788625951.816142:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788625951.816177:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788625951.816181:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788625951.816238:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625951.816283:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.816317:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.816419:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789312 00000100:00100000:3.0:1788625951.816425:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789312 00000100:00100000:3.0:1788625951.816459:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625951.816465:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.816808:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789312:12345-0@lo:501:mount.lustre.0 Request processed in 341us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.816815:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788625951.816995:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625951.817029:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625951.817070:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.817103:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.817236:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789440 00000100:00100000:3.0:1788625951.817240:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789440 00000100:00100000:3.0:1788625951.817267:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625951.817272:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625951.817587:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789440:12345-0@lo:503:mount.lustre.0 Request processed in 314us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.817592:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788625951.817833:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788625951.818267:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625951.818313:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625951.818344:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.818408:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.818483:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789568 00000100:00100000:3.0:1788625951.818487:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789568 00000100:00100000:3.0:1788625951.818536:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788625951.818542:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.818673:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789568:12345-0@lo:502:mount.lustre.0 Request processed in 131us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.818679:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625951.818750:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625951.818967:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788625951.819009:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788625951.819042:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788625951.819078:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788625951.819109:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788625951.819127:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788625951.819151:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788625951.819168:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788625951.819191:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788625951.819209:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625951.819237:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625951.819562:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625951.819612:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789696 00000100:00100000:1.0:1788625951.819616:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789696 00000100:00100000:1.0:1788625951.819636:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625951.819641:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625951.819832:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789696:12345-0@lo:502:mount.lustre.0 Request processed in 190us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.819840:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625951.819923:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625951.819973:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788625951.819987:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788625951.820636:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625951.820643:0:15728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788625951.820649:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.820651:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788625951.820654:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625951.820722:0:15728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b437a5db380) 00000020:00000080:0.0:1788625951.820766:0:15728:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788625951.820773:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625951.820838:0:15728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b43583db800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788625951.820845:0:15728:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625951.820863:0:15728:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8aede7274cb1496a 00010000:00010000:1.0:1788625951.825271:0:15728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788625951.825653:0:15728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788625951.827336:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788625951.828359:0:15728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788625951.828370:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625951.828375:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625951.828377:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788625951.828381:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625951.828384:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625951.828385:0:15728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625951.828387:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625951.828388:0:15728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788625951.828389:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625951.828391:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625951.828392:0:15728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788625951.828393:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625951.828394:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625951.828395:0:15728:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788625951.828396:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788625951.828487:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625951.828489:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625951.828490:0:15728:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625951.828493:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788625951.829758:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788625951.829802:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788625951.829825:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1495c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.829840:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43646e0800/0x8aede7274cb14955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb1495c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625951.829849:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b43583db800 from 1 10000000:01000000:3.0:1788625951.829852:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625951.829907:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.829914:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.829923:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625951.829944:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625951.830005:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.830043:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625951.830166:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789824 00000100:00100000:1.0:1788625951.830178:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789824 00000100:00100000:1.0:1788625951.830222:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788625951.830231:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:15726:x1875509845789824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625951.830245:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625951.830255:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14971 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.830274:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.830282:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.830287:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e1400, rc 0) 00000100:00100000:1.0:1788625951.830316:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845789824:12345-0@lo:101:mount.lustre.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.830320:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625951.830766:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625951.830781:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.830791:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625951.832028:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788625951.832965:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625951.833255:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788625951.833298:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788625951.833358:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788625951.833366:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788625951.833608:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.833840:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.833923:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625951.835533:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845789952 00000100:00100000:2.0:1788625951.835545:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845789952 00000100:00100000:3.0:1788625951.837643:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625951.837721:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845789952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.838117:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845789952:12345-0@lo:501:mount.lustre.0 Request processed in 462us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.838125:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625951.841165:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845789952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625951.841251:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625951.841327:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625951.841370:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.841544:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790080 00000100:00100000:3.0:1788625951.841550:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790080 00000100:00100000:3.0:1788625951.841601:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625951.841611:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625951.842029:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790080:12345-0@lo:503:mount.lustre.0 Request processed in 418us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.842037:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625951.842106:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625951.842896:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625951.842972:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.843024:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.843044:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625951.843154:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790208 00000100:00100000:1.0:1788625951.843160:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790208 00000100:00100000:1.0:1788625951.843192:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625951.843201:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625951.843391:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790208:12345-0@lo:502:mount.lustre.0 Request processed in 190us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.843398:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625951.843622:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625951.843935:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788625951.843983:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788625951.844035:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788625951.844074:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788625951.844247:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788625951.844297:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788625951.844335:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788625951.844369:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788625951.844399:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.844617:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.844779:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625951.845517:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790336 00000100:00100000:1.0:1788625951.845525:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790336 00000100:00100000:1.0:1788625951.845605:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625951.845615:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625951.845945:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790336:12345-0@lo:502:mount.lustre.0 Request processed in 331us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.845953:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788625951.846051:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625951.846199:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788625951.846213:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788625951.847314:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625951.847326:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.847328:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625951.847335:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b43583db800 00000020:00000080:0.0:1788625951.847337:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625951.847345:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625951.847348:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.847349:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788625951.847352:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625951.847354:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.847356:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625951.847367:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b43583db800 00000020:00000080:0.0:1788625951.847370:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625951.847521:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625951.847526:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.847528:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788625951.847530:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625951.847533:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.847535:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625951.847538:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b43583db800 00000020:00000080:0.0:1788625951.847540:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625951.849870:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625951.849883:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625951.849885:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788625951.849890:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788625951.850131:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788625951.850162:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625951.850182:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.850197:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625951.850252:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788625951.850255:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b43583db800 10000000:01000000:3.0:1788625951.850258:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b43583db800 10000000:01000000:3.0:1788625951.850262:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625951.850269:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b43583db800 from 1 10000000:01000000:3.0:1788625951.850272:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625951.850315:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.850324:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.850336:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625951.850361:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625951.850561:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.850597:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351b9f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625951.850901:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790464 00000100:00100000:0.0:1788625951.850909:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790464 00000100:00100000:0.0:1788625951.850962:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625951.850973:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845790464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625951.850989:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625951.851006:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4380743800/0x8aede7274cb14986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb1497f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.851031:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4380743800/0x8aede7274cb14986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb1497f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.851042:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4380743800/0x8aede7274cb14986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1497f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.851050:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4380743800, rc 0) 00000100:00100000:0.0:1788625951.852212:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790464:12345-0@lo:101:mount.lustre.0 Request processed in 1235us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625951.852234:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625951.853845:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625951.853887:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14986 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.853900:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14986 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625951.855341:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788625951.858900:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625951.859324:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788625951.859373:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788625951.859408:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788625951.860650:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788625951.861291:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788625951.861348:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788625951.861387:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788625951.862203:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788625951.862277:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788625951.862314:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788625951.862350:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788625951.862401:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788625951.863378:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788625951.864197:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788625951.864279:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788625951.864316:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788625951.864347:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788625951.864393:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788625951.865213:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788625951.865263:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788625951.865334:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788625951.865371:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788625951.865407:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788625951.866598:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788625951.866643:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788625951.867250:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788625951.867309:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788625951.867348:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788625951.867384:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788625951.868253:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788625951.868295:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788625951.868328:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788625951.868361:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788625951.868410:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788625951.869005:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788625951.869061:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788625951.869500:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788625951.869606:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788625951.869614:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788625951.870610:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625951.871559:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625951.872910:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4350190000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625951.878850:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790592 00000100:00100000:2.0:1788625951.878877:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790592 00000100:00100000:3.0:1788625951.884681:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625951.884697:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.887587:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790592:12345-0@lo:501:mount.lustre.0 Request processed in 2886us (16024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.887607:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625951.887693:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625951.887770:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625951.888003:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.888042:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4348f4e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.888373:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790720 00000100:00100000:3.0:1788625951.888380:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790720 00000100:00100000:3.0:1788625951.888484:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625951.888494:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625951.889910:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790720:12345-0@lo:503:mount.lustre.0 Request processed in 1410us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.889921:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625951.889990:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625951.891881:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625951.891965:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.892039:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.892076:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43510edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625951.892125:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790848 00000100:00100000:3.0:1788625951.892132:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790848 00000100:00100000:3.0:1788625951.892241:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788625951.892252:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.893129:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790848:12345-0@lo:502:mount.lustre.0 Request processed in 875us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625951.893139:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788625951.893216:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625951.893477:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788625951.893542:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788625951.893580:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788625951.893634:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788625951.893687:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788625951.893770:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788625951.894238:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788625951.894278:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788625951.894324:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788625951.894358:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788625951.894390:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788625951.894450:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788625951.894485:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788625951.894514:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788625951.894560:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788625951.894592:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788625951.894623:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788625951.894920:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788625951.894964:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788625951.894997:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788625951.895046:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788625951.895083:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788625951.896560:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788625951.896640:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788625951.896901:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788625951.896938:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788625951.896987:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788625951.897022:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788625951.897051:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788625951.897348:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788625951.897488:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788625951.897537:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788625951.897568:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788625951.897615:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788625951.897651:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788625951.898079:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788625951.898129:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788625951.898162:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788625951.898210:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788625951.898247:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788625951.898297:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625951.898377:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.898434:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625951.899094:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845790976 00000100:00100000:0.0:1788625951.899104:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845790976 00000100:00100000:0.0:1788625951.899159:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625951.899168:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625951.899394:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845790976:12345-0@lo:502:mount.lustre.0 Request processed in 226us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625951.899402:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625951.899675:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845790976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625951.900022:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788625951.900036:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788625951.901167:0:15737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788625951.901185:0:15737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b43463919c0) 00000020:00000080:3.0:1788625951.901208:0:15737:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788625951.901303:0:15737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b43583db800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788625951.901307:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b43583db800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788625951.901310:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b43583db800 3 00010000:00080000:3.0:1788625951.901339:0:15737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b4242582000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:3.0:1788625951.904403:0:15737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788625951.904913:0:15737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788625951.904956:0:15737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625951.904970:0:15737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8aede7274cb14994 00000100:00080000:3.0:1788625951.904982:0:15737:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625951.904990:0:15737:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b4242582000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625951.905027:0:15737:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c9880 x1875509845791104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625951.905077:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845791104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625951.907015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625951.907232:0:15737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625951.907303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625951.907308:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625951.907311:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625951.907317:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:3.0:1788625951.907321:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788625951.907327:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1788625951.907350:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b43798c9c00 x1875509845791360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625951.907405:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845791232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.907439:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.907478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845791488:0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.907502:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.907520:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625951.907525:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845791616:0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.907546:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.907583:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791232 00000100:00100000:3.0:1788625951.907591:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791232 00000100:00100000:3.0:1788625951.907646:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625951.907656:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845791232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.907706:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845791232:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625951.908275:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791104 00000100:00100000:2.0:1788625951.908281:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791104 00000100:00100000:2.0:1788625951.908297:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791488 00000100:00100000:2.0:1788625951.908305:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791488 00000100:00100000:2.0:1788625951.908326:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791616 00000100:00100000:2.0:1788625951.908328:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791616 00000100:00100000:2.0:1788625951.908344:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625951.908350:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845791488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625951.908407:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845791488:12345-0@lo:400:kworker.0 Request processed in 56us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625951.908414:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625951.908429:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625951.908436:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845791616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625951.908463:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845791616:12345-0@lo:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625951.908468:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625951.908479:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625951.908484:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875509845791104:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788625951.908504:0:14325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1788625951.908535:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8aede7274cb1499b 00000004:00100000:2.0:1788625951.908549:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788625951.908578:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9b4347944800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625951.908613:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875509845791104:12345-0@lo:38:llog_process_th.0 Request processed in 128us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625951.908619:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788625951.908690:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798c8a80 x1875509845791616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625951.908702:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845791616:0@lo:400:kworker.0 00010000:00080000:1.0:1788625951.908713:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798ca300 x1875509845791488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625951.908720:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845791488:0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.908881:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788625951.908912:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625951.908917:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625951.908939:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845791232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625951.908972:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845791360:0@lo:8:kworker.0 00000100:00100000:3.0:1788625951.909005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788625951.909042:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b43798c9880 x1875509845791104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625951.909051:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625951.909057:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788625951.909065:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788625951.909069:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625951.909072:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b4242582000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625951.909077:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875509845791104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625951.909442:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791360 00000100:00100000:1.0:1788625951.909448:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791360 00000100:00100000:1.0:1788625951.909482:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625951.909488:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875509845791360:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788625951.909620:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875509845791360:12345-0@lo:8:kworker.0 Request processed in 130us (613us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788625951.909628:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:3.0:1788625951.909913:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788625951.910127:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788625951.910157:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625951.910179:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14986 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.910191:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43821f6600/0x8aede7274cb1497f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14986 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788625951.910240:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788625951.910242:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788625951.910247:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625951.910248:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625951.910249:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625951.910251:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625951.910252:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625951.910254:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625951.910255:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788625951.910259:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788625951.910261:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788625951.910262:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788625951.910263:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625951.910264:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625951.910265:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625951.910266:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625951.910267:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625951.910268:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625951.910269:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788625951.910287:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788625951.910302:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845791744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788625951.910338:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.910366:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b434664ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625951.911038:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625951.911047:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625951.911052:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788625951.911055:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845791360:0@lo:8:kworker.0 00000100:00100000:2.0:1788625951.911144:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791744 00000100:00100000:2.0:1788625951.911150:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791744 00000100:00100000:2.0:1788625951.911215:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625951.911223:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:15726:x1875509845791744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625951.911247:0:14319:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788625951.911259:0:14319:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788625951.938531:0:14319:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788625951.938581:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788625951.939157:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788625951.939165:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788625951.939193:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.939221:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14875 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.939230:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.939290:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625951.939315:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 19 pid: 14319 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625951.939332:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379977480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845791872:0@lo:104: 00000100:00100000:3.0:1788625951.939426:0:14340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625951.939472:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625951.939625:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845791872 00000100:00100000:1.0:1788625951.939634:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845791872 00000100:00100000:1.0:1788625951.939718:0:14757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625951.939748:0:14757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845791872:12345-0@lo:104: 00010000:00010000:1.0:1788625951.939762:0:14757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.939861:0:14757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625951.939869:0:14757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:14340:x1875509845791872:12345-0@lo:104: Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.939876:0:14757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625951.939902:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379977480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1875509845791872:0@lo:104: 00010000:00010000:0.0:1788625951.939926:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940334:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625951.940341:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940358:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b000 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:1.0:1788625951.940362:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940371:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625951.940378:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625951.940383:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625951.940455:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940463:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625951.940485:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940492:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b434f94b000/0x8aede7274cb14875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb1487c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940511:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625951.940512:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625951.940514:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625951.940527:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3310:1875509845792000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625951.940564:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625951.940619:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792000 00000100:00100000:1.0:1788625951.940624:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792000 00010000:00010000:1.0:1788625951.940648:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 20 pid: 14319 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625951.940680:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625951.940689:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+20:3310:x1875509845792000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625951.940700:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625951.940706:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 20 pid: 14319 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940716:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 20 pid: 14319 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940747:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4380742000/0x8aede7274cb1487c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb14875 expref: 20 pid: 14319 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940761:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940769:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625951.940783:0:14310:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003219560s 00010000:00010000:1.0:1788625951.940798:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940807:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940814:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940821:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940833:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625951.940837:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940845:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940869:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625951.940881:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625951.940913:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3310:x1875509845792000:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625951.940920:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625951.940953:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3310:1875509845792000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625951.940974:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.940982:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625951.940988:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625951.949812:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:15726:x1875509845791744:12345-0@lo:253:mount.lustre.0 Request processed in 38581us (39463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625951.949827:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788625951.950008:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:15726:1875509845791744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788625951.950026:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788625951.950029:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625951.950032:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788625951.950033:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625951.950034:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625951.950035:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625951.950036:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625951.950038:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788625951.950040:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625951.950041:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788625951.950056:0:15726:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788625951.954555:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625951.954960:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625951.955206:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625951.955374:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788625951.955537:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788625951.955956:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788625951.957221:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788625952.027428:0:15726:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788625952.027436:0:15726:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788625952.027471:0:15726:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788625952.027530:0:15726:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788625952.027549:0:15726:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788625952.027576:0:15726:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788625952.053118:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625953.081120:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788625953.846961:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625953.846970:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b437996b800 from 8 10000000:01000000:0.0:1788625953.846975:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625953.847019:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625953.847033:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625953.847045:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625953.847086:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845792128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625953.847166:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625953.847218:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4343eef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625953.847269:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792128 00000100:00100000:3.0:1788625953.847277:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792128 00000100:00100000:3.0:1788625953.847335:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625953.847345:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845792128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625953.847358:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625953.847373:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb149a9 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625953.847399:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb149a9 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625953.847411:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43821f7a00/0x8aede7274cb149b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb149a9 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625953.847421:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43821f7a00, rc 0) 00000100:00100000:3.0:1788625953.847484:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845792128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625953.847491:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788625953.851561:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845792128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625953.851591:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb149b0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625953.851605:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb149b0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625953.851840:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845792256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788625953.851914:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625953.851961:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625953.852148:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792256 00000100:00100000:1.0:1788625953.852156:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792256 00000100:00100000:1.0:1788625953.852202:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788625953.852211:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845792256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625953.852230:0:14319:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625953.852246:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625953.852250:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788625953.852330:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845792256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625953.852337:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788625953.852379:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845792256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788625953.852430:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788625953.852442:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb149b0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625953.852452:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4380743e00/0x8aede7274cb149a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb149b0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625954.107676:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625954.803524:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845792384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625954.803602:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625954.803825:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792384 00000100:00100000:2.0:1788625954.803835:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792384 00000100:00100000:2.0:1788625954.803903:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625954.803914:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845792384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625954.803950:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625954.804004:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845792384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625954.804011:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625954.804060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845792384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625954.804126:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788625955.123042:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625956.147320:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625957.172403:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625957.369502:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625957.372585:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845792640:0@lo:400:kworker.0 00000100:00100000:2.0:1788625957.372662:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625957.372747:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845792512:0@lo:400:kworker.0 00000100:00100000:2.0:1788625957.372789:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625957.372834:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792640 00000100:00100000:2.0:1788625957.372843:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792640 00000100:00100000:2.0:1788625957.372902:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625957.372911:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845792640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625957.372965:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845792640:12345-0@lo:400:kworker.0 Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625957.372972:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625957.373022:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845792640:0@lo:400:kworker.0 00000100:00080000:0.0:1788625957.375827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625957.375846:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625957.375850:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625957.375862:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b434fcde800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1788625957.375901:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b4345f3d180 x1875509845792768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625957.375982:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845792768:0@lo:8:kworker.0 00000100:00100000:2.0:1788625957.376059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625957.376636:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792512 00000100:00100000:1.0:1788625957.376647:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792512 00000100:00100000:1.0:1788625957.376696:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788625957.376706:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3309:x1875509845792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625957.376809:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3309:x1875509845792512:12345-0@lo:400:kworker.0 Request processed in 105us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625957.376817:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788625957.376870:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845792512:0@lo:400:kworker.0 00000100:00080000:1.0:1788625957.376903:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625957.376968:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792768 00000100:00100000:3.0:1788625957.376980:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792768 00000100:00100000:3.0:1788625957.377014:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625957.377020:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875509845792768:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788625957.377045:0:15010:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788625957.377074:0:15010:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8aede7274cb149b7 00002000:00100000:3.0:1788625957.377087:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b4242582800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788625957.377091:0:15010:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788625957.377094:0:15010:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788625957.377440:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788625957.377461:0:15010:0:(import.c:65:import_set_state_nolock()) ffff9b4242586800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625957.377826:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845793024:0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.377861:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625957.377886:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625957.377892:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845792896:0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.377910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625957.377935:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793024 00000100:00100000:0.0:1788625957.377939:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793024 00000100:00100000:0.0:1788625957.377975:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845792896 00000100:00100000:0.0:1788625957.377978:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845792896 00000100:00100000:0.0:1788625957.377992:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625957.377998:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845793024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.378035:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845793024:12345-0@lo:400:kworker.0 Request processed in 37us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625957.378042:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625957.378056:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625957.378062:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.378088:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845792896:12345-0@lo:400:kworker.0 Request processed in 26us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625957.378094:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788625957.378125:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4345f3df80 x1875509845792896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625957.378152:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845792896:0@lo:400:kworker.0 00010000:00080000:0.0:1788625957.378166:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4345f3e300 x1875509845793024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625957.378175:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845793024:0@lo:400:kworker.0 00000100:00080000:0.0:1788625957.378209:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625957.378225:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625957.378233:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845793152:0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.378260:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625957.378281:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793152 00000100:00100000:0.0:1788625957.378285:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793152 00000100:00100000:0.0:1788625957.378332:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625957.378346:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845793152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625957.378378:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845793152:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625957.378384:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788625957.378396:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788625957.378412:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4345f3ca80 x1875509845793152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625957.378422:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845793152:0@lo:400:kworker.0 00000100:00100000:3.0:1788625957.379502:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875509845792768:12345-0@lo:8:kworker.0 Request processed in 2476us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625957.379513:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788625957.379645:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4345f3d180 x1875509845792768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625957.379660:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788625957.379668:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625957.379674:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788625957.379677:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b434fcde800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625957.379754:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625957.379770:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875509845792768:0@lo:8:kworker.0 00000004:00080000:0.0:1788625957.382703:0:14348:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788625957.383204:0:14348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 507379475006ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788625957.389930:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625957.390007:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625957.390065:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793280 00000100:00100000:3.0:1788625957.390072:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793280 00000100:00100000:3.0:1788625957.390122:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625957.390130:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845793280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625957.390161:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788625957.391520:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625957.394411:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845793280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4272us (4394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625957.394425:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788625957.394434:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b4379976d80 x1875509845793280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788625957.394475:0:14349:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788625957.394483:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625957.394519:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1875509845793408:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788625957.394557:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625957.394607:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d908480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625957.394640:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793408 00000100:00100000:0.0:1788625957.394647:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793408 00000100:00100000:0.0:1788625957.394699:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625957.394714:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14349:x1875509845793408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788625957.397340:0:15009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788625957.397351:0:15009:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788625957.397357:0:15009:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788625957.405156:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.405169:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405259:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.405264:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.405271:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405291:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405302:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405378:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405413:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625957.405981:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.405988:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.405997:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.406001:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.406006:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406016:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406025:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406034:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406111:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788625957.406510:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.406516:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406525:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.406535:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.406540:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406550:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406558:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.406693:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406833:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788625957.406842:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406850:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.406854:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406863:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406890:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406898:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb149be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406920:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625957.406924:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406930:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.406934:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406941:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406950:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406958:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406969:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.406973:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406985:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.406988:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.406996:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.407007:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.407015:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.407017:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.407018:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.407158:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.407163:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.407958:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.407966:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.407978:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.407983:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.407988:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.407999:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408015:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408024:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.408154:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.408161:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.408169:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.408173:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.408193:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.408206:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.408222:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.408224:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.408226:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.408418:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.408423:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb149d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.408913:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.408919:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408928:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.408931:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.408936:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408945:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408953:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.408971:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409060:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.409066:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409073:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.409077:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409085:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409097:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409105:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.409106:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.409108:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625957.409175:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.409256:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.409262:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb149da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.409746:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.409753:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.409774:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.409777:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.409782:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.409792:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.409800:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.409808:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.409996:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.410002:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410009:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.410013:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410028:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410040:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410048:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.410049:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.410051:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.410137:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.410142:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb149e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.410750:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.410766:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.410776:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.410780:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.410784:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.410794:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.410802:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.410809:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410865:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.410870:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.410878:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.410882:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.411151:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.411165:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.411173:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.411229:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.411232:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.411380:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.411386:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb149e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.411904:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.411910:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.411919:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.411922:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.411926:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.411936:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.411944:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.411950:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412054:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.412061:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412070:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.412074:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412083:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412097:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412107:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.412109:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.412111:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.412186:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.412192:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb149ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.412866:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.412873:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.412893:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.412896:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.412902:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.412912:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.412921:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.412928:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412974:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.412980:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.412989:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.412992:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.413001:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.413025:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.413033:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.413035:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.413037:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.413452:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.413459:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb149f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.413749:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.417931:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.417947:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.417967:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.417972:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.417979:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418007:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418018:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418027:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418048:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625957.418062:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625957.418068:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418076:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625957.418081:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418090:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418107:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418116:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065369629/0x8aede7274cb149fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.418142:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.418144:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.418146:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.419903:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.419913:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.419926:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.419931:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.419936:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.419948:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.419957:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.419965:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.419983:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625957.419995:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625957.420000:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420018:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625957.420022:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420030:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420045:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420053:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed9cec6/0x8aede7274cb14a04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420066:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.420069:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.420071:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.420905:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.420913:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420925:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.420928:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.420934:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420946:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420962:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420969:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.420985:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625957.420995:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625957.421000:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421007:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743c00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625957.421011:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421020:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421034:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421043:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f4f433/0x8aede7274cb14a0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421106:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.421116:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.421119:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625957.421130:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788625957.421894:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.421902:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421912:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.421916:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.421920:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421930:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421939:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421947:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421964:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625957.421975:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625957.421980:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.421987:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625957.421991:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.422005:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.422017:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.422024:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a830a3/0x8aede7274cb14a12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.422036:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.422038:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.422039:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.423065:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.423075:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423087:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.423090:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.423095:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423105:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423113:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423127:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423276:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625957.423716:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.423722:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423766:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.423770:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.423774:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423784:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423793:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.423800:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424275:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625957.424283:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424293:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743a00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.424297:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424316:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424334:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424342:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3b97e3/0x8aede7274cb14a19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424362:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.424366:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424380:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742e00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.424384:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424393:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424403:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.424411:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.424413:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.424415:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.424533:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.424539:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049ba95c8/0x8aede7274cb14a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.425039:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.425046:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425055:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.425060:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.425065:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425076:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425084:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425092:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.425257:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.425263:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.425271:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.425274:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.425283:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.425294:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.425376:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.425378:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.425380:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.425444:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.425449:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fca28da/0x8aede7274cb14a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.425946:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.425953:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425973:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.425976:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.425981:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425991:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.425998:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.426005:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426104:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.426110:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426118:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380742000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.426123:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426131:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426143:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426151:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.426152:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.426154:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.426245:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.426250:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9708dcc/0x8aede7274cb14a2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.426389:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.426925:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.426931:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.426940:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.426944:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.426949:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.426970:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.426979:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.426987:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.427039:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625957.427425:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.427431:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.427439:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.427442:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.427446:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.427455:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.427464:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.427481:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427682:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625957.427689:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427696:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4380743400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.427706:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427714:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427744:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427752:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2038bb7/0x8aede7274cb14a35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427780:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.427784:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427790:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4da00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.427793:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427799:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427808:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.427816:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.427822:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.427825:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.427901:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.427907:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d9222c/0x8aede7274cb14a3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.428477:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.428484:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.428493:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.428496:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.428501:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.428511:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.428519:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.428525:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.428630:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.428636:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.428644:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.428648:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.428657:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.428668:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.428676:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.428678:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.428680:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.428718:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.428723:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f7fc013/0x8aede7274cb14a43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.429778:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625957.429954:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.429962:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.429972:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.429975:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.429980:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.429990:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.429998:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430006:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430055:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625957.430469:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.430476:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430490:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.430493:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.430497:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430505:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430513:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.430520:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430750:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625957.430768:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430777:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4dc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.430782:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430803:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430818:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430826:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3f3bf67/0x8aede7274cb14a4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430844:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.430848:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430854:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.430857:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430864:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430874:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.430882:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.430884:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.430892:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.430982:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.430987:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05441ce/0x8aede7274cb14a51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.431663:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.431670:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.431680:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.431683:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.431688:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.431711:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.431720:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.431751:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.431811:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.431817:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.431824:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.431828:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.431837:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.431849:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.431857:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.431858:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.431860:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.431919:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.431925:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004105d46d/0x8aede7274cb14a58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.432481:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.432488:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.432497:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.432500:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.432504:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.432513:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.432532:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.432539:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.432627:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.432632:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.432639:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.432643:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.432650:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.432674:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.432682:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.432684:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.432686:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.432856:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.432862:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf076a4/0x8aede7274cb14a5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.433455:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.433462:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.433472:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.433475:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.433480:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.433489:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.433498:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.433518:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.433545:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.433551:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.433624:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4ce00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.433630:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.433639:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.433652:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.433661:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.433662:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.433664:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.433767:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.433773:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d7e120/0x8aede7274cb14a66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.434324:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.434330:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.434339:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.434343:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.434348:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.434358:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.434366:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.434374:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.434513:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.434519:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.434537:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.434540:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.434549:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.434632:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.434642:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.434644:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.434646:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.434725:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.434746:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d346fc3d/0x8aede7274cb14a6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.435842:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.435850:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.435862:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.435866:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.435871:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.435883:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.435891:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.435898:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.436021:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.436029:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.436037:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.436042:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.436051:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.436066:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.436082:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.436084:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.436086:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.436258:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.436265:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069172f61/0x8aede7274cb14a74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625957.436971:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788625957.436979:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.436989:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1788625957.436993:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625957.436997:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.437008:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.437016:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625957.437023:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.437097:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625957.437103:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.437110:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4c200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625957.437114:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.437122:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.437267:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625957.437278:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.437280:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625957.437282:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625957.437406:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625957.437412:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ed17dd8/0x8aede7274cb14a7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788625957.437744:0:15009:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788625957.437852:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14349:x1875509845793408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 43140us (43289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625957.437873:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625957.437940:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1875509845793408:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788625957.437957:0:14349:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788625957.438002:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1875509845793536:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788625957.438053:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625957.438086:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b42410a0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625957.438429:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793536 00000100:00100000:0.0:1788625957.438436:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793536 00000100:00100000:0.0:1788625957.438483:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625957.438493:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14349:x1875509845793536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788625957.438538:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788625957.440663:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625957.450772:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14349:x1875509845793536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12263us (12702us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788625957.450786:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625957.452391:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1875509845793536:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788625957.452412:0:14349:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788625958.194937:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625959.212672:0:16085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788625959.219274:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625959.924027:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625959.924052:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845793664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625959.924119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625959.924176:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793664 00000100:00100000:2.0:1788625959.924186:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793664 00000100:00100000:2.0:1788625959.924381:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625959.924403:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845793664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625959.924468:0:15012:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625959.924539:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845793664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625959.924547:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788625959.924606:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625959.924692:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845793664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788625960.243091:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625961.267821:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625961.486636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.487336:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823775872 00000100:00100000:1.0:1788625961.487349:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823775872 00000100:00100000:1.0:1788625961.487405:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1788625961.487415:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875509823775872:12345-192.168.201.45@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788625961.487445:0:14318:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5be9537b-fe13-4af9-884b-2c4cda6cee72@192.168.201.45@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1788625961.487476:0:14318:0:(genops.c:1385:class_connect()) connect: client 5be9537b-fe13-4af9-884b-2c4cda6cee72, cookie 0x8aede7274cb14a82 00000100:00080000:1.0:1788625961.487662:0:14318:0:(import.c:65:import_set_state_nolock()) ffff9b4242e25000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625961.488028:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+5:2362:x1875509823775872:12345-192.168.201.45@tcp:250:mount.lustre.0 Request processed in 611us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.488037:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:0.0:1788625961.502815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625961.503040:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776000 00000100:00100000:2.0:1788625961.503052:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776000 00000100:00100000:2.0:1788625961.503188:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:2.0:1788625961.503200:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+5:13785:x1875509823776000:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625961.503219:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625961.503238:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94b400/0x8aede7274cb14a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf22 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.503269:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94b400/0x8aede7274cb14a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf22 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.503281:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94b400/0x8aede7274cb14a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf22 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.503290:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b400, rc 0) 00000100:00100000:2.0:1788625961.503356:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+6:13785:x1875509823776000:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 159us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.503363:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:3.0:1788625961.510959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.511806:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776128 00000100:00100000:1.0:1788625961.511818:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776128 00000100:00100000:1.0:1788625961.511880:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:1.0:1788625961.511890:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+6:13785:x1875509823776128:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788625961.513329:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+6:13785:x1875509823776128:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 1431us (2373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625961.513342:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:1.0:1788625961.521245:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625961.521625:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776256 00000100:00100000:0.0:1788625961.521637:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776256 00000100:00100000:0.0:1788625961.521724:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:0.0:1788625961.521836:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+6:13785:x1875509823776256:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625961.521854:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625961.521884:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb14a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf29 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625961.521914:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb14a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf29 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625961.521926:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4d000/0x8aede7274cb14a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf29 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625961.521935:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d000, rc 0) 00000100:00100000:0.0:1788625961.522180:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+7:13785:x1875509823776256:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 346us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625961.522188:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:0.0:1788625961.531050:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.531260:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776384 00000100:00100000:1.0:1788625961.531269:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776384 00000100:00100000:1.0:1788625961.531373:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:1.0:1788625961.531383:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+7:13785:x1875509823776384:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788625961.531702:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13785:x1875509823776384:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 319us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.531717:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1788625961.536310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625961.536416:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776512 00000100:00100000:0.0:1788625961.536428:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776512 00000100:00100000:0.0:1788625961.536498:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1788625961.536509:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13785:x1875509823776512:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788625961.537267:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13785:x1875509823776512:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 756us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625961.537277:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1788625961.545634:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.547510:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776640 00000100:00100000:1.0:1788625961.547525:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776640 00000100:00100000:1.0:1788625961.547599:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1788625961.547610:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13803:x1875509823776640:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625961.547922:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13803:x1875509823776640:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 312us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.547929:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000040:00080000:3.0:1788625961.587912:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625961.602449:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.603191:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776768 00000100:00100000:1.0:1788625961.603205:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776768 00000100:00100000:1.0:1788625961.603275:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:1.0:1788625961.603287:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13803:x1875509823776768:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625961.603852:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13803:x1875509823776768:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 564us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.603862:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1788625961.624987:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625961.625130:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823776896 00000100:00100000:2.0:1788625961.625143:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823776896 00000100:00100000:2.0:1788625961.625212:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:2.0:1788625961.625223:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+8:13785:x1875509823776896:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625961.625266:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625961.625286:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94b600/0x8aede7274cb14a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf53 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.625319:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94b600/0x8aede7274cb14a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf53 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.625331:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94b600/0x8aede7274cb14a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf53 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625961.625340:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b600, rc 0) 00000100:00100000:2.0:1788625961.625417:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+9:13785:x1875509823776896:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 195us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.625424:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:0.0:1788625961.634678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.634942:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777024 00000100:00100000:1.0:1788625961.634954:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777024 00000100:00100000:1.0:1788625961.635012:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:1.0:1788625961.635023:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+9:13785:x1875509823777024:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788625961.635049:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788625961.635203:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788625961.635208:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788625961.635211:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788625961.635214:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788625961.651825:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+9:13785:x1875509823777024:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 16791us (17147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.651854:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:3.0:1788625961.656329:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.656504:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777152 00000100:00100000:1.0:1788625961.656514:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777152 00000100:00100000:1.0:1788625961.656580:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:1.0:1788625961.656590:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+9:13785:x1875509823777152:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625961.656618:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625961.656637:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf5a expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625961.656668:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625961.656681:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625961.656701:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e0400, rc 0) 00000100:00100000:1.0:1788625961.656792:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13785:x1875509823777152:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.656802:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1788625961.664616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.666333:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777280 00000100:00100000:1.0:1788625961.666348:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777280 00000100:00100000:1.0:1788625961.666417:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:1.0:1788625961.666426:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13785:x1875509823777280:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788625961.666781:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13785:x1875509823777280:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 355us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.666790:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:0.0:1788625961.672351:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625961.673042:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777408 00000100:00100000:2.0:1788625961.673055:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777408 00000100:00100000:2.0:1788625961.673136:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:2.0:1788625961.673149:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13785:x1875509823777408:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788625961.673403:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13785:x1875509823777408:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 256us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.673412:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:0.0:1788625961.679183:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625961.679417:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777536 00000100:00100000:3.0:1788625961.679427:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777536 00000100:00100000:3.0:1788625961.679493:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:3.0:1788625961.679503:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13809:x1875509823777536:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625961.679861:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13809:x1875509823777536:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 358us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625961.679870:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:0.0:1788625961.691176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.691294:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777664 00000100:00100000:1.0:1788625961.691308:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777664 00000100:00100000:1.0:1788625961.691379:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:1.0:1788625961.691391:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13809:x1875509823777664:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625961.692030:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13809:x1875509823777664:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 639us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.692041:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1788625961.711248:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625961.711548:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777792 00000100:00100000:2.0:1788625961.711560:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777792 00000100:00100000:2.0:1788625961.711657:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1788625961.711667:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1875509823777792:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788625961.711712:0:14325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 48479f8b-3181-4d66-9752-cb1b70d3443c@192.168.201.45@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1788625961.711807:0:14325:0:(genops.c:1385:class_connect()) connect: client 48479f8b-3181-4d66-9752-cb1b70d3443c, cookie 0x8aede7274cb14aa5 00000004:00100000:2.0:1788625961.711841:0:14325:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788625961.711849:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788625961.788672:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9b437d709000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625961.788819:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2362:x1875509823777792:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 77149us (77580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.788831:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1788625961.795888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625961.795932:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.796039:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778048 00000100:00100000:1.0:1788625961.796049:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778048 00000100:00100000:1.0:1788625961.796120:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823777920 00000100:00100000:1.0:1788625961.796124:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823777920 00000100:00100000:1.0:1788625961.796142:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625961.796152:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:13785:x1875509823778048:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625961.796204:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788625961.796308:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:13785:x1875509823778048:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 157us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.796316:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625961.796336:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625961.796342:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+6:0:x1875509823777920:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625961.796353:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788625961.796377:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+6:0:x1875509823777920:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 35us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.796383:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:0.0:1788625961.798194:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625961.798893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625961.799203:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778176 00000100:00100000:0.0:1788625961.799215:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778176 00000100:00100000:0.0:1788625961.799315:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1788625961.799328:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+6:13785:x1875509823778176:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788625961.799432:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+6:13785:x1875509823778176:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 107us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625961.799440:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1788625961.803785:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.803826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625961.803872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625961.804122:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778560 00000100:00100000:3.0:1788625961.804135:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778560 00000100:00100000:3.0:1788625961.804195:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625961.804207:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:13785:x1875509823778560:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788625961.804902:0:14327:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 603us 00000100:00100000:2.0:1788625961.811174:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778304 00000100:00100000:2.0:1788625961.811192:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778304 00000100:00100000:2.0:1788625961.811243:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778432 00000100:00100000:2.0:1788625961.811247:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778432 00000100:00100000:2.0:1788625961.811269:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625961.811278:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1875509823778304:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625961.811315:0:15007:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 48479f8b-3181-4d66-9752-cb1b70d3443c@192.168.201.45@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1788625961.811352:0:15007:0:(genops.c:1385:class_connect()) connect: client 48479f8b-3181-4d66-9752-cb1b70d3443c, cookie 0x8aede7274cb14aac 00002000:00100000:2.0:1788625961.811365:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48479f8b-3181-4d66-9752-cb1b70d3443c/ffff9b437d70c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625961.811389:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625961.811815:0:15007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625961.811855:0:15007:0:(import.c:65:import_set_state_nolock()) ffff9b437d70b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625961.811926:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2362:x1875509823778304:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 648us (8099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.811935:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625961.811957:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1788625961.811963:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1875509823778432:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625961.811979:0:15007:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 48479f8b-3181-4d66-9752-cb1b70d3443c@192.168.201.45@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1788625961.812018:0:15007:0:(genops.c:1385:class_connect()) connect: client 48479f8b-3181-4d66-9752-cb1b70d3443c, cookie 0x8aede7274cb14ab3 00002000:00100000:2.0:1788625961.812024:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48479f8b-3181-4d66-9752-cb1b70d3443c/ffff9b437d70c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625961.812042:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625961.812160:0:15007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625961.812175:0:15007:0:(import.c:65:import_set_state_nolock()) ffff9b437d70e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625961.812198:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2362:x1875509823778432:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 234us (8325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625961.812205:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000004:00200000:1.0:1788625961.833657:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788625961.833845:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:13785:x1875509823778560:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 29634us (30065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625961.833861:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1788625962.019691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625962.019874:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778688 00000100:00100000:3.0:1788625962.019887:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778688 00000100:00100000:3.0:1788625962.019941:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1788625962.019950:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:13830:x1875509823778688:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:3.0:1788625962.019974:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625962.020007:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3800/0x8aede7274cb14aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf84 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020091:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020131:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020150:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625962.020198:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625962.020202:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625962.020246:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020275:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3800/0x8aede7274cb14aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf84 expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020296:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf84 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625962.020304:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:3.0:1788625962.020320:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625962.020325:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3200, rc 0) 00000100:00100000:3.0:1788625962.020628:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+7:13830:x1875509823778688:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 677us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625962.020636:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000001:00100000:2.0:1788625962.101874:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48479f8b-3181-4d66-9752-cb1b70d3443c 00010000:00010000:1.0:1788625962.291007:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625962.483173:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845793792:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483314:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845794304:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483353:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483383:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625962.483389:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483446:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845793920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483472:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845794432:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483527:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625962.483532:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625962.483591:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794304 00000100:00100000:0.0:1788625962.483598:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794304 00000100:00100000:0.0:1788625962.483663:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794176 00000100:00100000:0.0:1788625962.483666:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794176 00000100:00100000:0.0:1788625962.483689:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794432 00000100:00100000:0.0:1788625962.483692:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794432 00000100:00100000:0.0:1788625962.483708:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625962.483716:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483796:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845794304:12345-0@lo:400:kworker.0 Request processed in 79us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625962.483803:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625962.483823:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625962.483829:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845794176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483855:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845794176:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625962.483860:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625962.483871:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625962.483877:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845794432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.483905:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845794432:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625962.483911:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625962.483936:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793920 00000100:00100000:0.0:1788625962.483939:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793920 00000100:00100000:0.0:1788625962.483965:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794048 00000100:00100000:0.0:1788625962.483969:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794048 00000100:00100000:0.0:1788625962.483985:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625962.483992:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845793920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484021:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845793920:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625962.484037:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625962.484049:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625962.484055:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845794048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484101:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875509845794048:12345-0@lo:400:kworker.0 Request processed in 46us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625962.484107:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788625962.484122:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625962.484126:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625962.484128:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625962.484161:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484175:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845793920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484187:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845794432:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484223:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625962.484232:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845794304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625962.484471:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845793792 00000100:00100000:3.0:1788625962.484477:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845793792 00000100:00100000:3.0:1788625962.484512:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625962.484518:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845793792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625962.484562:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845793792:12345-0@lo:400:kworker.0 Request processed in 44us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625962.484576:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625962.484615:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845793792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625962.485555:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845794560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625962.485607:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625962.485762:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794560 00000100:00100000:3.0:1788625962.485768:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794560 00000100:00100000:3.0:1788625962.485800:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625962.485808:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875509845794560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625962.485826:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625962.485870:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875509845794560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625962.485876:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625962.485911:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845794560:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788625962.611871:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788625962.611926:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48479f8b-3181-4d66-9752-cb1b70d3443c 00000001:00100000:3.0:1788625962.611938:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788625963.315942:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625963.954096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625963.954220:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778816 00000100:00100000:1.0:1788625963.954231:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778816 00000100:00100000:1.0:1788625963.954333:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625963.954346:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:13882:x1875509823778816:12345-192.168.201.45@tcp:41:lfs.0 00000004:00000024:1.0:1788625963.954390:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788625963.954481:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:13882:x1875509823778816:12345-192.168.201.45@tcp:41:lfs.0 Request processed in 138us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625963.954489:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00080000:2.0:1788625963.954705:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625963.958768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625963.958913:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823778944 00000100:00100000:0.0:1788625963.958927:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823778944 00000100:00100000:0.0:1788625963.959043:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1788625963.959057:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48479f8b-3181-4d66-9752-cb1b70d3443c+5:13882:x1875509823778944:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:0.0:1788625963.959114:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625963.959226:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48479f8b-3181-4d66-9752-cb1b70d3443c+5:13882:x1875509823778944:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 173us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625963.959234:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:2.0:1788625963.959440:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625963.965931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625963.966018:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779072 00000100:00100000:3.0:1788625963.966032:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779072 00000100:00100000:3.0:1788625963.966139:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1788625963.966153:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48479f8b-3181-4d66-9752-cb1b70d3443c+5:13882:x1875509823779072:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:3.0:1788625963.966209:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625963.966327:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48479f8b-3181-4d66-9752-cb1b70d3443c+5:13882:x1875509823779072:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 177us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625963.966335:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00080000:2.0:1788625963.966493:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625964.176027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.176195:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779200 00000100:00100000:0.0:1788625964.176205:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779200 00000100:00100000:0.0:1788625964.176477:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:0.0:1788625964.176489:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+10:13914:x1875509823779200:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625964.176509:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625964.176530:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4c800/0x8aede7274cb14ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cf8b expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.176564:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4c800/0x8aede7274cb14ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf8b expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.176579:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4c800/0x8aede7274cb14ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf8b expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.176590:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c800, rc 0) 00000100:00100000:0.0:1788625964.176674:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779200:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 187us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.176681:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:2.0:1788625964.188008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.188129:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779328 00000100:00100000:0.0:1788625964.188140:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779328 00000100:00100000:0.0:1788625964.188252:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1788625964.188264:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779328:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625964.189391:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779328:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 1114us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.189404:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:1.0:1788625964.204896:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.205405:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779456 00000100:00100000:0.0:1788625964.205417:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779456 00000100:00100000:0.0:1788625964.205614:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:0.0:1788625964.205624:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779456:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788625964.206061:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779456:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 436us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.206069:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1788625964.229715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.230576:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779584 00000100:00100000:0.0:1788625964.230589:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779584 00000100:00100000:0.0:1788625964.230662:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:0.0:1788625964.230672:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13921:x1875509823779584:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625964.231113:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13921:x1875509823779584:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 394us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.231123:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:2.0:1788625964.246252:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625964.246766:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779712 00000100:00100000:3.0:1788625964.246777:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779712 00000100:00100000:3.0:1788625964.246855:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:3.0:1788625964.246866:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13921:x1875509823779712:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625964.247171:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13921:x1875509823779712:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 305us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625964.247179:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:2.0:1788625964.253937:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625964.257360:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779840 00000100:00100000:1.0:1788625964.257375:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779840 00000100:00100000:1.0:1788625964.257624:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:1.0:1788625964.257636:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13914:x1875509823779840:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625964.257664:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625964.257682:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43646e0e00/0x8aede7274cb14acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cfb5 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.257746:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e0e00/0x8aede7274cb14acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfb5 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.257759:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43646e0e00/0x8aede7274cb14acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfb5 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.257770:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e0e00, rc 0) 00000100:00100000:1.0:1788625964.257843:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13914:x1875509823779840:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 208us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.257850:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:2.0:1788625964.263512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.263826:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823779968 00000100:00100000:0.0:1788625964.263837:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823779968 00000100:00100000:0.0:1788625964.263903:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:0.0:1788625964.263914:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13914:x1875509823779968:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788625964.263942:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788625964.263968:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788625964.263972:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788625964.263976:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788625964.263978:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788625964.274435:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13914:x1875509823779968:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 10512us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.274461:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:2.0:1788625964.279065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625964.279226:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780096 00000100:00100000:1.0:1788625964.279237:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780096 00000100:00100000:1.0:1788625964.279300:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:1.0:1788625964.279310:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13914:x1875509823780096:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625964.279328:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625964.279345:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cfbc expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.279375:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.279387:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625964.279396:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e0c00, rc 0) 00000100:00100000:1.0:1788625964.279476:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13914:x1875509823780096:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 158us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.279503:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:2.0:1788625964.282040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.282139:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780224 00000100:00100000:0.0:1788625964.282149:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780224 00000100:00100000:0.0:1788625964.282222:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:0.0:1788625964.282232:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13914:x1875509823780224:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625964.282757:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13914:x1875509823780224:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 494us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.282766:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1788625964.288884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625964.290656:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780352 00000100:00100000:3.0:1788625964.290674:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780352 00000100:00100000:3.0:1788625964.290781:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:3.0:1788625964.290792:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13914:x1875509823780352:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788625964.291216:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13914:x1875509823780352:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 424us (2341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625964.291224:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:2.0:1788625964.306233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625964.306346:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780480 00000100:00100000:1.0:1788625964.306361:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780480 00000100:00100000:1.0:1788625964.306432:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1788625964.306444:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13926:x1875509823780480:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625964.306832:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13926:x1875509823780480:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 388us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.306840:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:2.0:1788625964.310325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.310445:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780608 00000100:00100000:0.0:1788625964.310456:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780608 00000100:00100000:0.0:1788625964.310528:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:0.0:1788625964.310539:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13926:x1875509823780608:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625964.310835:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13926:x1875509823780608:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 296us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.310844:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:2.0:1788625964.320240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.320965:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780736 00000100:00100000:0.0:1788625964.320976:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780736 00000100:00100000:0.0:1788625964.321031:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1788625964.321039:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1875509823780736:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625964.321070:0:14325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c4eff845-5876-4960-81d4-b2d1a5f68f7f@192.168.201.45@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1788625964.321124:0:14325:0:(genops.c:1385:class_connect()) connect: client c4eff845-5876-4960-81d4-b2d1a5f68f7f, cookie 0x8aede7274cb14add 00000004:00100000:0.0:1788625964.321158:0:14325:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625964.321294:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9b4344d33800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625964.321383:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2362:x1875509823780736:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 343us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.321391:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1788625964.331215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625964.331259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625964.331336:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780992 00000100:00100000:3.0:1788625964.331347:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780992 00000100:00100000:3.0:1788625964.331410:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823780864 00000100:00100000:3.0:1788625964.331413:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823780864 00000100:00100000:3.0:1788625964.331436:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625964.331458:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+7:13914:x1875509823780992:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625964.331514:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788625964.331589:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+7:13914:x1875509823780992:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 133us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625964.331597:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625964.331616:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1788625964.331623:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:0:x1875509823780864:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625964.331633:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788625964.331701:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:0:x1875509823780864:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625964.331708:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00080000:2.0:1788625964.332082:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625964.335143:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625964.335263:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781120 00000100:00100000:3.0:1788625964.335274:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781120 00000100:00100000:3.0:1788625964.335337:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625964.335347:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:13914:x1875509823781120:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788625964.335515:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:13914:x1875509823781120:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 169us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625964.335523:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00010000:00010000:1.0:1788625964.338863:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625964.345085:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625964.345122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625964.345193:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781248 00000100:00100000:1.0:1788625964.345205:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781248 00000100:00100000:0.0:1788625964.345253:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781376 00000100:00100000:0.0:1788625964.345258:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781376 00000100:00100000:1.0:1788625964.345264:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625964.345274:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875509823781248:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788625964.345312:0:15010:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c4eff845-5876-4960-81d4-b2d1a5f68f7f@192.168.201.45@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1788625964.345349:0:15010:0:(genops.c:1385:class_connect()) connect: client c4eff845-5876-4960-81d4-b2d1a5f68f7f, cookie 0x8aede7274cb14ae4 00002000:00100000:1.0:1788625964.345362:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4eff845-5876-4960-81d4-b2d1a5f68f7f/ffff9b43441ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625964.345374:0:15010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625964.345671:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788625964.345705:0:15010:0:(import.c:65:import_set_state_nolock()) ffff9b43441ea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625964.345832:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2362:x1875509823781248:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 557us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.345842:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1788625964.345861:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1788625964.345865:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875509823781376:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788625964.345889:0:15010:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c4eff845-5876-4960-81d4-b2d1a5f68f7f@192.168.201.45@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1788625964.345904:0:15010:0:(genops.c:1385:class_connect()) connect: client c4eff845-5876-4960-81d4-b2d1a5f68f7f, cookie 0x8aede7274cb14aeb 00002000:00100000:1.0:1788625964.345911:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c4eff845-5876-4960-81d4-b2d1a5f68f7f/ffff9b43441ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625964.345916:0:15010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625964.346060:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788625964.346090:0:15010:0:(import.c:65:import_set_state_nolock()) ffff9b43441ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625964.346113:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2362:x1875509823781376:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 247us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.346119:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1788625964.347826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625964.351514:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781504 00000100:00100000:1.0:1788625964.351590:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781504 00000100:00100000:1.0:1788625964.351752:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1788625964.351766:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:13914:x1875509823781504:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788625964.351852:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788625964.351970:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:13914:x1875509823781504:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 207us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625964.351978:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1788625964.706340:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625964.707495:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781632 00000100:00100000:0.0:1788625964.707515:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781632 00000100:00100000:0.0:1788625964.707592:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1788625964.707602:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:13947:x1875509823781632:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:0.0:1788625964.707621:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625964.707665:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb14af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cfe6 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707777:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707792:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707806:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625964.707844:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788625964.707848:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625964.707870:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707895:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c200/0x8aede7274cb14af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 8 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707912:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625964.707921:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:0.0:1788625964.707925:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625964.707942:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4dc00, rc 0) 00000100:00100000:0.0:1788625964.708002:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+7:13947:x1875509823781632:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 401us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625964.708009:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1788625965.043041:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625965.043069:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43805cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845794688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625965.043171:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625965.043328:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794688 00000100:00100000:0.0:1788625965.043337:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794688 00000100:00100000:0.0:1788625965.043411:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625965.043420:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845794688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625965.043476:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788625965.043545:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845794688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625965.043552:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625965.043599:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43805cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845794688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625965.043915:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788625965.363129:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625966.391380:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625967.164089:0:15490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4eff845-5876-4960-81d4-b2d1a5f68f7f 00000001:00100000:2.0:1788625967.165753:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4eff845-5876-4960-81d4-b2d1a5f68f7f 00000001:00100000:2.0:1788625967.165770:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48479f8b-3181-4d66-9752-cb1b70d3443c 00010000:00010000:0.0:1788625967.419809:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625967.603000:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845794944:0@lo:400:kworker.0 00000100:00100000:1.0:1788625967.603011:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845795200:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.603107:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845794816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625967.611469:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625967.611867:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795200 00000100:00100000:0.0:1788625967.611878:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795200 00000100:00100000:0.0:1788625967.611931:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625967.611942:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845795200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625967.612080:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875509845795200:12345-0@lo:400:kworker.0 Request processed in 139us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625967.612087:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625967.613834:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875509845795200:0@lo:400:kworker.0 00000100:00100000:3.0:1788625967.616807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845795072:0@lo:400:kworker.0 00000100:00100000:3.0:1788625967.616875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625967.616925:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845795584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625967.616948:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625967.616984:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795072 00000100:00100000:0.0:1788625967.616992:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795072 00000100:00100000:0.0:1788625967.617052:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625967.617129:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795584 00000100:00100000:3.0:1788625967.617133:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795584 00000100:00100000:3.0:1788625967.617159:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625967.617165:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845795584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625967.617206:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625967.617252:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875509845795584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625967.617259:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625967.617306:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788625967.617327:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845795584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625967.617363:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845795072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625967.617405:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875509845795072:12345-0@lo:400:kworker.0 Request processed in 344us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625967.617417:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788625967.619379:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625967.619443:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625967.619483:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794816 00000100:00100000:2.0:1788625967.619491:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794816 00000100:00100000:2.0:1788625967.619533:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625967.619542:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.619596:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845794816:12345-0@lo:400:kworker.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625967.619603:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625967.619659:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845794816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.619831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845795328:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.619868:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625967.619895:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795328 00000100:00100000:2.0:1788625967.619898:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795328 00000100:00100000:2.0:1788625967.619946:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625967.619952:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845795328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.619984:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875509845795328:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625967.619990:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788625967.620004:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625967.620033:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875509845795328:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.620095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875509845795072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.620792:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625967.620823:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845794944 00000100:00100000:2.0:1788625967.620828:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845794944 00000100:00100000:2.0:1788625967.620868:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625967.620874:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.620908:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845794944:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625967.620915:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788625967.620929:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625967.620951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845794944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.620959:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845795456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.620985:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625967.621006:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795456 00000100:00100000:2.0:1788625967.621009:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795456 00000100:00100000:2.0:1788625967.621035:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625967.621041:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845795456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625967.621070:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875509845795456:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625967.621075:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788625967.621088:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625967.621104:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875509845795456:0@lo:400:kworker.0 00000001:00100000:2.0:1788625967.705141:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4eff845-5876-4960-81d4-b2d1a5f68f7f 00000001:02000400:1.0:1788625967.881477:0:16290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788625968.435068:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625969.463253:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625969.823060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625969.823124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625969.823154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625969.823185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625969.823204:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625969.823220:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625969.823893:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782144 00000100:00100000:1.0:1788625969.824334:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782144 00000100:00100000:1.0:1788625969.824480:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782400 00000100:00100000:1.0:1788625969.824494:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782400 00000100:00100000:1.0:1788625969.824514:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782016 00000100:00100000:1.0:1788625969.824517:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782016 00000100:00100000:1.0:1788625969.824537:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625969.824561:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823782144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625969.824647:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823782144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 88us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625969.824654:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625969.824671:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1788625969.824677:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823782400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625969.824698:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823782400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625969.824704:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1788625969.824713:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1788625969.824718:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823782016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625969.824773:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823782016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 54us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625969.825028:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781888 00000100:00100000:3.0:1788625969.825035:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781888 00000100:00100000:3.0:1788625969.825072:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782272 00000100:00100000:3.0:1788625969.825077:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782272 00000100:00100000:3.0:1788625969.825092:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1788625969.825099:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2363:x1875509823781888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625969.825131:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2363:x1875509823781888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625969.825136:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1788625969.825150:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1788625969.825156:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2363:x1875509823782272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625969.825179:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2363:x1875509823782272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625969.825185:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1788625969.825440:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00080000:0.0:1788625969.825844:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625969.825849:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625969.825851:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625969.825864:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823781760 00000100:00100000:0.0:1788625969.825869:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823781760 00000100:00100000:0.0:1788625969.826553:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:0.0:1788625969.826565:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2363:x1875509823781760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1788625969.826613:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2363:x1875509823781760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 51us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625969.826620:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:2.0:1788625969.827845:0:15007:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625969.827858:0:15007:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788625969.827943:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1788625969.828072:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782528 00000100:00100000:1.0:1788625969.828080:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782528 00000100:00080000:1.0:1788625969.828103:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625969.828141:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1788625969.828228:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823782528:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1788625969.828289:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823782528:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 141us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625969.828305:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1788625970.163114:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625970.163138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625970.163213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625970.163456:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845795712 00000100:00100000:3.0:1788625970.163466:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845795712 00000100:00100000:3.0:1788625970.163545:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625970.163556:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845795712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625970.163607:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788625970.163656:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845795712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625970.163663:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625970.163710:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845795712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625970.163810:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788625970.484520:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625971.508009:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625971.829108:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788625972.060157:0:16439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd86045260 20000000:00000080:2.0:1788625972.060175:0:16439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b4364520000 uarg=0000000000000000 20000000:01000000:2.0:1788625972.060213:0:16439:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625972.060220:0:16439:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625972.060225:0:16439:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788625972.062260:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788625972.062456:0:16439:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788625972.076663:0:16439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788625972.076701:0:16439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076720:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076754:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb1483d expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076761:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076770:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076777:0:16439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076784:0:16439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076831:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.076847:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 12 pid: 14320 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625972.076887:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845795840:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625972.077020:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.077030:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625972.077039:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845795968:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625972.077070:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.077078:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625972.077086:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796096:0@lo:104: 00000100:00100000:1.0:1788625972.077125:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625972.077169:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.077178:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 18 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625972.077185:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796224:0@lo:104: 00000100:00100000:1.0:1788625972.077204:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625972.077237:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796096 00000100:00100000:1.0:1788625972.077246:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796096 00000100:00100000:3.0:1788625972.077269:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796224 00000100:00100000:3.0:1788625972.077273:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796224 00000100:00100000:3.0:1788625972.077297:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625972.077305:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+4:16439:x1875509845796096:12345-0@lo:104: 00010000:00010000:3.0:1788625972.077319:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.077376:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625972.077382:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+4:16439:x1875509845796096:12345-0@lo:104: Request processed in 78us (256us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625972.078218:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625972.078228:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078237:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f6c00 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:0.0:1788625972.078242:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078251:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625972.078277:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625972.078282:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788625972.078337:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078344:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625972.078365:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078373:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f6c00/0x8aede7274cb14971 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14978 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078387:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625972.078388:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625972.078390:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625972.078410:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845796352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625972.078453:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625972.078501:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796352 00000100:00100000:0.0:1788625972.078518:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796352 00010000:00010000:0.0:1788625972.078545:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 19 pid: 14319 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625972.078575:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625972.078584:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845796352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625972.078595:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625972.078600:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 19 pid: 14319 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078615:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 19 pid: 14319 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.078634:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625972.078667:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3311:x1875509845796352:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625972.078675:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625972.078719:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3311:1875509845796352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625972.080679:0:16439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.080699:0:16439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 18 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625972.080714:0:16439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796480:0@lo:104: 00000100:00100000:0.0:1788625972.080962:0:16439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625972.080991:0:16439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4352037300 going to sleep for 11 seconds 00010000:00010000:0.0:1788625972.081271:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43646e1400/0x8aede7274cb14978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb14971 expref: 18 pid: 14319 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625972.081286:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796096:0@lo:104: 00000100:00100000:1.0:1788625972.081721:0:14757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625972.081777:0:14757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+4:16439:x1875509845796224:12345-0@lo:104: 00010000:00010000:1.0:1788625972.081792:0:14757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625972.081959:0:14757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625972.081966:0:14757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+4:16439:x1875509845796224:12345-0@lo:104: Request processed in 195us (4759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625972.081973:0:14757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625972.084261:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625972.090760:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796224:0@lo:104: 00000100:00100000:1.0:1788625972.093095:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788625972.094883:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625972.094897:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.094910:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43821f7200 already unused, calling callback (ffffffffc1c72c20) 10000000:00010000:3.0:1788625972.094914:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.094924:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625972.094955:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625972.094961:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625972.095030:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095036:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625972.095060:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095066:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b43821f7200/0x8aede7274cb1483d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb14844 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095082:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625972.095083:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625972.095085:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625972.095164:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796480 00000100:00100000:3.0:1788625972.095171:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796480 00000100:00100000:3.0:1788625972.095211:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625972.095220:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4356bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:16439:x1875509845796480:12345-0@lo:104: 00010000:00010000:3.0:1788625972.095231:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:3.0:1788625972.095288:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625972.095294:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4356bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+3:16439:x1875509845796480:12345-0@lo:104: Request processed in 75us (14333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625972.095300:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625972.095321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:3.0:1788625972.095348:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625972.095353:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095359:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d200 already unused, calling callback (ffffffffc1c72c20) 00000100:00100000:2.0:1788625972.095360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845796608:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788625972.095362:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095369:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625972.095375:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625972.095381:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625972.095394:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625972.095400:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625972.095406:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095412:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d200/0x8aede7274cb147f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8aede7274cb147f7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.095425:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625972.095426:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625972.095428:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625972.095433:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625972.095439:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845796736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625972.095457:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625972.095460:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782656 00000100:00100000:3.0:1788625972.095463:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782656 00010000:00010000:3.0:1788625972.095481:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 13 pid: 14320 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095485:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782784 00000100:00100000:2.0:1788625972.095488:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782784 00000100:00100000:3.0:1788625972.095527:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796608 00000100:00100000:3.0:1788625972.095530:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796608 00010000:00010000:2.0:1788625972.095531:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 14 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095543:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796736 00000100:00100000:2.0:1788625972.095546:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796736 00010000:00010000:2.0:1788625972.095556:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 19 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095576:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1788625972.095582:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5be9537b-fe13-4af9-884b-2c4cda6cee72+14:2365:x1875509823782656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625972.095593:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625972.095599:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 14 pid: 14320 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095610:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 14 pid: 14320 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095633:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625972.095672:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5be9537b-fe13-4af9-884b-2c4cda6cee72+14:2365:x1875509823782656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 90us (436us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625972.095677:0:16439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43646e0c00/0x8aede7274cb14ad6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfbc expref: 14 pid: 14320 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095679:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1788625972.095688:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845795840:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625972.095691:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1788625972.095697:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:2364:x1875509823782784:12345-192.168.201.45@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788625972.095699:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845795968:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625972.095705:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625972.095709:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625972.095715:0:16439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16439:1875509845796480:0@lo:104: 00010000:00010000:2.0:1788625972.095718:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095754:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43646e0400/0x8aede7274cb14a9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf5a expref: 12 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095764:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625972.095786:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:2364:x1875509823782784:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 90us (465us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625972.095789:0:16439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095792:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1788625972.095834:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625972.095841:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3308:x1875509845796736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625972.095849:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625972.095853:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 19 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095862:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 19 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095873:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b434f94ac00/0x8aede7274cb147f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb147f0 expref: 19 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625972.095885:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625972.095918:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 18 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625972.095920:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:3308:x1875509845796736:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625972.095926:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625972.095936:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625972.095976:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845796736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625972.096009:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:3308:x1875509845796608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625972.096021:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625972.096026:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 17 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096035:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 17 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096045:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b4379c4ca00/0x8aede7274cb14844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8aede7274cb1483d expref: 17 pid: 14318 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096055:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096118:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096135:0:14312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096141:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096148:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096160:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096166:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0000 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625972.096171:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.096179:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.100885:0:16439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625972.100905:0:16439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.103887:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.103908:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b43646e0000/0x8aede7274cb14b00 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625972.103931:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625972.104101:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:3308:x1875509845796608:12345-0@lo:103:ldlm_bl.0 Request processed in 8153us (8697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625972.104111:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625972.104346:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3308:1875509845796608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625972.532103:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625972.724305:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625972.724336:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845796864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625972.724412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625972.724481:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796864 00000100:00100000:1.0:1788625972.724489:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796864 00000100:00100000:1.0:1788625972.724556:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625972.724565:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845796864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625972.724600:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625972.724646:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845796864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625972.724653:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788625972.724675:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625972.724706:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845796864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625972.725755:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845797120:0@lo:400:kworker.0 00000100:00100000:2.0:1788625972.725798:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625972.725823:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625972.725830:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845797248:0@lo:400:kworker.0 00000100:00100000:2.0:1788625972.725849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625972.725884:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797120 00000100:00100000:2.0:1788625972.725904:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797120 00000100:00100000:2.0:1788625972.725939:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797248 00000100:00100000:2.0:1788625972.725942:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797248 00000100:00100000:2.0:1788625972.725963:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625972.725970:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625972.726011:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875509845797120:12345-0@lo:400:kworker.0 Request processed in 42us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625972.726019:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625972.726031:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625972.726037:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625972.726061:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845797248:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625972.726067:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625972.726161:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845796992:0@lo:400:kworker.0 00000100:00100000:3.0:1788625972.726196:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625972.726225:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625972.726231:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845797376:0@lo:400:kworker.0 00000100:00100000:3.0:1788625972.726252:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625972.726288:0:14324:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625972.726308:0:14324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788625972.726339:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625972.726345:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797376 00000100:00100000:3.0:1788625972.726348:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797376 00000100:00100000:1.0:1788625972.726451:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845796992 00000100:00100000:1.0:1788625972.726455:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845796992 00000100:00100000:1.0:1788625972.726487:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625972.726504:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845796992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625972.726545:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845796992:12345-0@lo:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625972.726559:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788625972.726651:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625972.726655:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625972.726785:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845796992:0@lo:400:kworker.0 00000100:00100000:1.0:1788625972.727135:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845797248:0@lo:400:kworker.0 00000100:00100000:1.0:1788625972.727147:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875509845797120:0@lo:400:kworker.0 00000100:00100000:3.0:1788625972.742643:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625972.742682:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845797376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625972.742796:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875509845797376:12345-0@lo:400:kworker.0 Request processed in 123us (16541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625972.742804:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625972.742861:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875509845797376:0@lo:400:kworker.0 00000100:00100000:3.0:1788625973.465438:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625973.465538:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823782912 00000100:00100000:2.0:1788625973.465547:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823782912 00000100:00100000:2.0:1788625973.465605:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:2.0:1788625973.465615:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+11:13799:x1875509823782912:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625973.465632:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625973.465654:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b434f94be00/0x8aede7274cb14b07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cfed expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625973.465686:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b434f94be00/0x8aede7274cb14b07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfed expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625973.465698:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b434f94be00/0x8aede7274cb14b07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfed expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625973.465707:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94be00, rc 0) 00000100:00100000:2.0:1788625973.465794:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823782912:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 180us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625973.465801:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:2.0:1788625973.471104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625973.471182:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783040 00000100:00100000:0.0:1788625973.471196:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783040 00000100:00100000:0.0:1788625973.471268:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:0.0:1788625973.471280:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434f9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823783040:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.471608:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434f9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823783040:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 330us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.471616:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:2.0:1788625973.477698:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625973.477843:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783168 00000100:00100000:3.0:1788625973.477853:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783168 00000100:00100000:3.0:1788625973.477913:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:3.0:1788625973.477925:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823783168:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.478150:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823783168:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 227us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625973.478158:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 10000000:01000000:0.0:1788625973.492120:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788625973.492127:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b43583db800 from 10 10000000:01000000:0.0:1788625973.492132:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625973.492294:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.492307:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.492332:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625973.492359:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.492435:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625973.492499:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4380771600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625973.492523:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797504 00000100:00100000:0.0:1788625973.492530:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797504 00000100:00100000:0.0:1788625973.492587:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625973.492598:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+16:14322:x1875509845797504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625973.492610:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625973.492626:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4da00/0x8aede7274cb14b15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14b0e expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.492651:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4da00/0x8aede7274cb14b15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14b0e expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.492663:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4da00/0x8aede7274cb14b15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14b0e expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.492673:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4da00, rc 0) 00000100:00100000:0.0:1788625973.492801:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.492808:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788625973.493298:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625973.493315:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b15 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.493324:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14b15 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625973.493384:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.493415:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625973.493448:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625973.493506:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797632 00000100:00100000:0.0:1788625973.493511:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797632 00000100:00100000:0.0:1788625973.493545:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625973.493555:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.494117:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 562us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.494126:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625973.494232:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.494278:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.494318:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625973.494354:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4352cab780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625973.494373:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797760 00000100:00100000:0.0:1788625973.494377:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797760 00000100:00100000:0.0:1788625973.494410:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625973.494419:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.494604:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.494613:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625973.494662:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.494997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625973.495066:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783296 00000100:00100000:0.0:1788625973.495072:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783296 00000100:00100000:0.0:1788625973.495099:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:0.0:1788625973.495107:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+12:13799:x1875509823783296:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625973.495116:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625973.495131:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b4379c4c400/0x8aede7274cb14b1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cff4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.495152:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b4379c4c400/0x8aede7274cb14b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cff4 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.495186:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b4379c4c400/0x8aede7274cb14b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cff4 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.495195:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c400, rc 0) 00000100:00100000:0.0:1788625973.495234:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13799:x1875509823783296:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.495240:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000040:00080000:1.0:1788625973.496120:0:16492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788625973.496415:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788625973.496434:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625973.496443:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b15 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.496453:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4379c4c600/0x8aede7274cb14b0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b15 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625973.496463:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788625973.496466:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b4346657800 from 10 10000000:01000000:0.0:1788625973.496469:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625973.496509:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.496517:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625973.496527:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625973.496549:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.496604:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625973.496640:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435dbaf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625973.496955:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845797888 00000100:00100000:1.0:1788625973.496962:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845797888 00000100:00100000:3.0:1788625973.497189:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788625973.497202:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+17:14322:x1875509845797888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625973.497214:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625973.497226:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43429d3800/0x8aede7274cb14b2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14b23 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.497249:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43429d3800/0x8aede7274cb14b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14b23 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.497260:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43429d3800/0x8aede7274cb14b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14b23 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.497269:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3800, rc 0) 00000100:00100000:3.0:1788625973.497340:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845797888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625973.497348:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788625973.497386:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845797888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625973.497401:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b2a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.497411:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14b2a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625973.497473:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.497512:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625973.509010:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db21000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625973.509316:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798016 00000100:00100000:0.0:1788625973.509324:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798016 00000100:00100000:3.0:1788625973.512458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625973.512623:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783424 00000100:00100000:1.0:1788625973.512634:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783424 00000100:00100000:1.0:1788625973.512683:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1788625973.512694:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13799:x1875509823783424:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.512997:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13799:x1875509823783424:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 304us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625973.513007:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:0.0:1788625973.513527:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788625973.513538:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845798016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625973.513696:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845798016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (16181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625973.513704:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788625973.513832:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.513887:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.513938:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625973.513967:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db21000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625973.518893:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798144 00000100:00100000:3.0:1788625973.518909:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798144 00000100:00100000:3.0:1788625973.518968:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625973.518978:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845798144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.519248:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845798144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625973.519256:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788625973.520068:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625973.525875:0:16493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788625973.525977:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788625973.526004:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625973.526018:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b2a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.526030:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b4379c4d800/0x8aede7274cb14b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b2a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625973.526042:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625973.526044:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b437996b800 from 10 10000000:01000000:3.0:1788625973.526048:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625973.526109:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.526119:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.526133:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625973.526180:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.526270:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625973.526337:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625973.530987:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798272 00000100:00100000:1.0:1788625973.531001:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798272 00000100:00100000:1.0:1788625973.531077:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788625973.531088:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+18:14322:x1875509845798272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625973.531109:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625973.531131:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b43646e0200/0x8aede7274cb14b38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8aede7274cb14b31 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.531179:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b43646e0200/0x8aede7274cb14b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8aede7274cb14b31 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.531192:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b43646e0200/0x8aede7274cb14b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8aede7274cb14b31 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.531203:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e0200, rc 0) 00000100:00100000:1.0:1788625973.531297:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845798272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625973.531304:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625973.531867:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625973.531888:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b38 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.531899:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8aede7274cb14b38 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625973.531974:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.532013:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625973.532052:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625973.532099:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798400 00000100:00100000:2.0:1788625973.532105:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798400 00000100:00100000:2.0:1788625973.532139:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788625973.532148:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845798400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625973.532567:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845798400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 419us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625973.532576:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788625973.533208:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.533245:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.533418:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625973.533450:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625973.534917:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798528 00000100:00100000:1.0:1788625973.534928:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798528 00000100:00100000:1.0:1788625973.534985:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788625973.534995:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845798528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625973.535212:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:14322:x1875509845798528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625973.535220:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625973.535266:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:14322:1875509845798528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625973.537021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625973.537439:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783552 00000100:00100000:3.0:1788625973.537449:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783552 00000100:00100000:3.0:1788625973.537521:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1788625973.537532:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13799:x1875509823783552:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625973.537943:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:13799:x1875509823783552:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 411us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625973.537959:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000040:00080000:3.0:1788625973.543538:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788625973.543776:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788625973.543797:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625973.543808:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b38 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625973.543821:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b43429d3a00/0x8aede7274cb14b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8aede7274cb14b38 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625973.555785:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625974.579668:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625974.937115:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937231:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625974.937342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625974.937564:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784064 00000100:00100000:3.0:1788625974.937575:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784064 00000100:00100000:3.0:1788625974.937643:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784320 00000100:00100000:3.0:1788625974.937647:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784320 00000100:00100000:3.0:1788625974.937660:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783936 00000100:00100000:3.0:1788625974.937662:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783936 00000100:00100000:3.0:1788625974.937676:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784448 00000100:00100000:3.0:1788625974.937678:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784448 00000100:00100000:3.0:1788625974.937693:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625974.937703:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823784064:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.937806:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823784064:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 104us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.937815:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625974.937833:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1788625974.937852:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823784320:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.937880:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823784320:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.937886:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1788625974.937898:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625974.937904:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823783936:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.937926:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2363:x1875509823783936:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.937943:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1788625974.937956:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1788625974.937963:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823784448:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.937988:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2363:x1875509823784448:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.937994:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00080000:3.0:1788625974.938012:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625974.938016:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625974.938042:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783808 00000100:00100000:3.0:1788625974.938047:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783808 00000100:00100000:3.0:1788625974.938077:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784192 00000100:00100000:3.0:1788625974.938080:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784192 00000100:00100000:3.0:1788625974.938101:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1788625974.938108:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2363:x1875509823783808:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.938137:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2363:x1875509823783808:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.938158:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1788625974.938171:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1788625974.938177:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2363:x1875509823784192:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1788625974.938203:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2363:x1875509823784192:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625974.938209:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00080000:3.0:1788625974.938229:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625974.938779:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823783680 00000100:00100000:2.0:1788625974.938786:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823783680 00000100:00100000:2.0:1788625974.938828:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:2.0:1788625974.938846:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2363:x1875509823783680:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625974.938880:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2363:x1875509823783680:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 45us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625974.938886:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:3.0:1788625975.283355:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845798656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625975.283613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625975.283815:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845798656 00000100:00100000:1.0:1788625975.283823:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845798656 00000100:00100000:1.0:1788625975.283894:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625975.284027:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845798656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625975.284068:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788625975.284126:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845798656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625975.284133:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625975.284183:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845798656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788625975.284298:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788625975.603524:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625976.176832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.176911:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784576 00000100:00100000:3.0:1788625976.176921:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784576 00000100:00100000:3.0:1788625976.177002:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1788625976.177014:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+6:14458:x1875509823784576:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625976.177035:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.177059:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14b3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7cffb expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177122:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177148:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177162:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177176:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177183:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177190:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625976.177509:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788625976.177877:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2200/0x8aede7274cb14b54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177901:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2200/0x8aede7274cb14b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177910:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2200/0x8aede7274cb14b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.177940:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625976.177944:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.177981:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2200/0x8aede7274cb14b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177992:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.177999:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178005:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178010:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.178014:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178021:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178033:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:3.0:1788625976.178036:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.178041:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178057:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178072:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178078:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178084:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178089:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.178092:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178098:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178105:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b4352039000) 00010000:00010000:3.0:1788625976.178108:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.178111:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178116:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14b4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178342:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14b3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cffb expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178371:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2200/0x8aede7274cb14b54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cffb expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.178379:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039a00) 00010000:00010000:3.0:1788625976.178381:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625976.178384:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2200, rc 0) 00000100:00100000:3.0:1788625976.178530:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+7:14458:x1875509823784576:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1518us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.178539:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:2.0:1788625976.190570:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.190715:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784832 00000100:00100000:3.0:1788625976.190725:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784832 00000100:00100000:3.0:1788625976.190813:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1788625976.190832:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+7:14458:x1875509823784832:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625976.190853:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.190874:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d002 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.190951:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.190966:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.190978:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191028:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191049:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191057:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191795:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14b70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191808:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14b70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.191951:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14b70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.191964:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788625976.192452:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192461:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192469:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192475:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.192480:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192488:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192513:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b4352039a00) 00010000:00010000:3.0:1788625976.192516:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.192520:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192526:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14b62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192541:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192548:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192554:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192559:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.192562:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192568:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192576:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b4352039700) 00010000:00010000:3.0:1788625976.192578:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.192581:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.192586:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14b69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.193706:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d002 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.194010:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3c00/0x8aede7274cb14b70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d002 expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.194022:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b4352039200) 00010000:00010000:3.0:1788625976.194024:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.194028:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3c00, rc 0) 00000100:00100000:3.0:1788625976.194102:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14458:x1875509823784832:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3270us (3539us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788625976.194111:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625976.198151:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.198774:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823784960 00000100:00100000:3.0:1788625976.198784:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823784960 00000100:00100000:3.0:1788625976.198923:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1788625976.198935:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14458:x1875509823784960:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788625976.199047:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14458:x1875509823784960:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 115us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.199055:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1788625976.275990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625976.276465:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785088 00000100:00100000:2.0:1788625976.276476:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785088 00000100:00100000:2.0:1788625976.276550:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625976.276561:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14464:x1875509823785088:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1788625976.276583:0:16453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625976.276637:0:16453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d009 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.276702:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277120:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277137:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277155:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277337:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277346:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277555:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277563:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277570:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277576:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94bc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625976.277580:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277598:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277610:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:2.0:1788625976.277614:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625976.277619:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277625:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94bc00/0x8aede7274cb14b85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277639:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277645:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277650:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277655:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625976.277658:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277664:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277671:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b4356b43a00) 00010000:00010000:2.0:1788625976.277673:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625976.277676:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.277692:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a000/0x8aede7274cb14b8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.280008:0:16453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14b7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d009 expref: 10 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.280031:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:2.0:1788625976.280034:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625976.280040:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b200/0x8aede7274cb14b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d009 expref: 10 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.280058:0:16453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94b200, rc 0) 00000100:00100000:2.0:1788625976.280139:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14464:x1875509823785088:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 3578us (4159us total) trans 0 rc 301/301 00000100:00100000:2.0:1788625976.280148:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625976.297993:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.298074:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785216 00000100:00100000:1.0:1788625976.298084:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785216 00000100:00100000:1.0:1788625976.298139:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1788625976.298150:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14464:x1875509823785216:12345-192.168.201.45@tcp:700:lfs.0 00000100:00100000:1.0:1788625976.298247:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14464:x1875509823785216:12345-192.168.201.45@tcp:700:lfs.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625976.298255:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1788625976.311142:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.311314:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785472 00000100:00100000:3.0:1788625976.311324:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785472 00000100:00100000:3.0:1788625976.311387:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1788625976.311399:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14464:x1875509823785472:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:3.0:1788625976.311468:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625976.311498:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cf84 expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.311533:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:3.0:1788625976.311538:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625976.312189:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.312206:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 5 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.312215:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.312253:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 5 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.312269:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 5 pid: 14326 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625976.312284:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14326:1875509845798784:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625976.312384:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435d908d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625976.325969:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14326:1875509845798784:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625976.326001:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625976.326395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625976.330270:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785600 00000100:00100000:2.0:1788625976.330286:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785600 00010000:00010000:2.0:1788625976.330418:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 6 pid: 14326 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625976.330479:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625976.330491:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2366:x1875509823785600:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625976.330508:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625976.330515:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 6 pid: 14326 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330548:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 6 pid: 14326 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330572:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4dc00/0x8aede7274cb14af9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7cfe6 expref: 6 pid: 14326 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330590:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:2.0:1788625976.330596:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330625:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330634:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.330670:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625976.330767:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2366:x1875509823785600:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 278us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625976.330774:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00010000:00010000:1.0:1788625976.332691:0:14326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.332754:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.332789:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.332801:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.332812:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625976.334026:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788625976.334041:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334051:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334058:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334064:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625976.334069:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334076:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334092:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039d00) 00010000:00010000:1.0:1788625976.334095:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625976.334107:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.334113:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14b93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625976.334137:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a54541c0 reply state 0000000077c0e2a2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625976.334146:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625976.334228:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+10:14464:x1875509823785472:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 22828us (23094us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788625976.334237:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:0.0:1788625976.339756:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625976.340594:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340617:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340622:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340626:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625976.340630:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340635:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340648:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b436f250e00) 00010000:00010000:0.0:1788625976.340662:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625976.340666:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.340671:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0600/0x8aede7274cb14b9a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625976.466981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.467219:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785728 00000100:00100000:3.0:1788625976.467230:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785728 00000100:00100000:3.0:1788625976.467294:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:3.0:1788625976.467305:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+9:14472:x1875509823785728:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:3.0:1788625976.467338:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.467358:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d010 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.467419:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14ba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.467443:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.467456:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.467489:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625976.467492:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.468178:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.468209:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d010 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.468230:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2400/0x8aede7274cb14ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d010 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.468238:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:3.0:1788625976.468241:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625976.468245:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2400, rc 0) 00000100:00100000:3.0:1788625976.468379:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+10:14472:x1875509823785728:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 1075us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.468398:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1788625976.494004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.497226:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785856 00000100:00100000:3.0:1788625976.497243:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785856 00000100:00100000:3.0:1788625976.497388:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1788625976.497402:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:14473:x1875509823785856:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625976.497423:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.497458:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d017 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497524:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14bb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497539:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497549:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.497585:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625976.497588:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.497626:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497651:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d017 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497671:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3000/0x8aede7274cb14bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d017 expref: 6 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.497701:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:3.0:1788625976.497704:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625976.497708:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3000, rc 0) 00000100:00100000:3.0:1788625976.497837:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:14473:x1875509823785856:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 437us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.497843:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:0.0:1788625976.506951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.507100:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823785984 00000100:00100000:1.0:1788625976.507111:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823785984 00000100:00100000:1.0:1788625976.507176:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1788625976.507187:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:14473:x1875509823785984:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625976.507207:0:16453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625976.507230:0:16453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14bbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d01e expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507293:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507308:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507321:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507355:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507363:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507370:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507513:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507522:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507529:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625976.507560:0:16453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788625976.507564:0:16453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625976.507580:0:16453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507592:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507790:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507796:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507811:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1800 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625976.507815:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507822:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507834:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:1.0:1788625976.507837:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625976.507841:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507848:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507920:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507926:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507932:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507936:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625976.507939:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507946:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507964:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b436f250400) 00010000:00010000:1.0:1788625976.507966:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625976.507970:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.507975:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14bcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.508008:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14bbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d01e expref: 8 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.508021:0:16453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d01e expref: 7 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.508028:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b436f250b00) 00010000:00010000:1.0:1788625976.508030:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625976.508033:0:16453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e1000, rc 0) 00000100:00100000:1.0:1788625976.508097:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eff845-5876-4960-81d4-b2d1a5f68f7f+7:14473:x1875509823785984:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 911us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625976.508104:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1788625976.523291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.523555:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823786240 00000100:00100000:1.0:1788625976.523567:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823786240 00000100:00100000:1.0:1788625976.523775:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:1.0:1788625976.523789:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+7:14473:x1875509823786240:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625976.523822:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625976.523846:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d025 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625976.523963:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788625976.524095:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14bd9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d025 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.524109:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:1.0:1788625976.524113:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625976.525572:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d025 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.525596:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e1e00, rc 0) 00000100:00100000:1.0:1788625976.525688:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+8:14473:x1875509823786240:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1901us (2404us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788625976.525697:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:0.0:1788625976.531146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.531323:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823786496 00000100:00100000:1.0:1788625976.531335:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823786496 00000100:00100000:1.0:1788625976.531405:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1788625976.531415:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eff845-5876-4960-81d4-b2d1a5f68f7f+8:14473:x1875509823786496:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:1.0:1788625976.531486:0:16453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625976.531513:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d01e expref: 8 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.531532:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b436f250b00) 00010000:00010000:1.0:1788625976.531544:0:16453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625976.531569:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.531716:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.531762:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625976.531993:0:16453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1b8407d reply state 000000007ac9239a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625976.532002:0:16453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788625976.532011:0:16453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788625976.532332:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eff845-5876-4960-81d4-b2d1a5f68f7f+9:14473:x1875509823786496:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 916us (1194us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788625976.532341:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1788625976.535241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.535301:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823786752 00000100:00100000:1.0:1788625976.535310:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823786752 00000100:00100000:1.0:1788625976.535364:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:1.0:1788625976.535374:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+9:14473:x1875509823786752:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625976.535596:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+10:14473:x1875509823786752:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 224us (367us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788625976.535616:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00010000:00010000:2.0:1788625976.537324:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537341:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537349:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537372:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625976.537377:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537386:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537403:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b436f250400) 00010000:00010000:2.0:1788625976.537406:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788625976.537410:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625976.537416:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1c00/0x8aede7274cb14be7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625976.544439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.544522:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787008 00000100:00100000:3.0:1788625976.544532:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787008 00000100:00100000:3.0:1788625976.544594:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:3.0:1788625976.544605:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+9:14473:x1875509823787008:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625976.544634:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.544656:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d02c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544791:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544806:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544828:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544843:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544851:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.544876:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.544987:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788625976.545079:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545086:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545093:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545099:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.545103:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545111:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545123:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:3.0:1788625976.545125:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.545130:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545136:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545150:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545166:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545172:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545178:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2600 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.545181:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545188:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545195:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b4352039000) 00010000:00010000:3.0:1788625976.545198:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.545200:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545206:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14bfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545380:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14bee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d02c expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545390:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:3.0:1788625976.545392:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625976.545396:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d02c expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.545417:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3200, rc 0) 00000100:00100000:3.0:1788625976.545487:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+10:14473:x1875509823787008:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 882us (1069us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788625976.545496:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:0.0:1788625976.553285:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.553380:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787136 00000100:00100000:3.0:1788625976.553392:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787136 00000100:00100000:3.0:1788625976.553486:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1788625976.553497:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+10:14473:x1875509823787136:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1788625976.553523:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.553545:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14c0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d033 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553671:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553686:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553697:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.553723:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625976.553761:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.553781:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553810:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14c0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553844:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.553853:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b4352039000) 00010000:00010000:3.0:1788625976.553856:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625976.553860:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d2600, rc 0) 00000100:00100000:3.0:1788625976.553973:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+11:14473:x1875509823787136:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 477us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.553981:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1788625976.564713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.564878:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787264 00000100:00100000:1.0:1788625976.564889:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787264 00000100:00100000:1.0:1788625976.564951:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1788625976.564961:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+11:14473:x1875509823787264:12345-192.168.201.45@tcp:37:lfs.0 00000100:00100000:1.0:1788625976.569606:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+11:14473:x1875509823787264:12345-192.168.201.45@tcp:37:lfs.0 Request processed in 4635us (4891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625976.569632:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1788625976.575996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.576085:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787520 00000100:00100000:3.0:1788625976.576096:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787520 00000100:00100000:3.0:1788625976.576162:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:3.0:1788625976.576174:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43451ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+11:14473:x1875509823787520:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1788625976.576465:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43451ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+12:14473:x1875509823787520:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 293us (479us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788625976.576473:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00010000:00010000:0.0:1788625976.632251:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625976.668038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.668164:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787648 00000100:00100000:3.0:1788625976.668175:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787648 00000100:00100000:3.0:1788625976.668244:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:3.0:1788625976.668255:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+10:14479:x1875509823787648:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625976.668274:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.668296:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14c18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d03a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668362:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668391:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668403:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668416:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668454:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668461:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668557:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14c2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668566:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668573:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.668601:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788625976.668605:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.668667:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668679:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668694:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668701:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668706:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d2c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.668710:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668718:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668767:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:3.0:1788625976.668770:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.668775:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668781:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2c00/0x8aede7274cb14c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668798:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668804:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668810:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668816:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43429d3e00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.668828:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668835:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668843:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b4352039300) 00010000:00010000:3.0:1788625976.668846:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.668849:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668855:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3e00/0x8aede7274cb14c26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668892:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3200/0x8aede7274cb14c18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d03a expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668905:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d3600/0x8aede7274cb14c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d03a expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.668913:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b4352039000) 00010000:00010000:3.0:1788625976.668916:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788625976.668919:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43429d3600, rc 0) 00000100:00100000:3.0:1788625976.668987:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+11:14479:x1875509823787648:12345-192.168.201.45@tcp:101:bash.0 Request processed in 733us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.668994:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1788625976.674071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.674290:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823787904 00000100:00100000:3.0:1788625976.674301:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823787904 00000100:00100000:3.0:1788625976.674367:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1788625976.674378:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+11:14479:x1875509823787904:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625976.674415:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.674449:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14c34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d041 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.674578:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.674595:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.674605:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.674640:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.674654:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 11 pid: 14324 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625976.674668:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845798912:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625976.674804:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43807713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625976.680371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.680474:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823788032 00000100:00100000:1.0:1788625976.680485:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823788032 00010000:00010000:1.0:1788625976.680529:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 12 pid: 14324 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625976.680574:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1788625976.680585:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+12:2366:x1875509823788032:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625976.680600:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625976.680608:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 12 pid: 14324 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.680623:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 12 pid: 14324 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.681000:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b4352039000) 00010000:00010000:1.0:1788625976.681006:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.681017:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.681026:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.681048:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625976.681105:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4eff845-5876-4960-81d4-b2d1a5f68f7f+12:2366:x1875509823788032:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 520us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625976.681132:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00010000:00010000:3.0:1788625976.681495:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2600/0x8aede7274cb14c11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d033 expref: 11 pid: 14324 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625976.681515:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4379976a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845798912:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625976.681538:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.681557:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.681563:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.681585:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.681596:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.681604:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683301:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683323:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683335:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.683347:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788625976.683378:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683385:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683392:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683408:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fc000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.683413:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683421:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683445:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b4352039000) 00010000:00010000:3.0:1788625976.683448:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625976.683452:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683458:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c3b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625976.683473:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000875bef37 reply state 00000000afc951f9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625976.683481:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788625976.683519:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43429d2000/0x8aede7274cb14c34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683535:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.683542:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625976.683545:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788625976.683547:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fce00, rc 0) 00000100:00100000:3.0:1788625976.683617:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14479:x1875509823787904:12345-192.168.201.45@tcp:101:bash.0 Request processed in 9241us (9557us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788625976.685059:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00010000:00010000:1.0:1788625976.691395:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691415:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691433:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691439:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fcc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625976.691444:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691453:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691469:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b4352039300) 00010000:00010000:1.0:1788625976.691472:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625976.691477:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.691483:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fcc00/0x8aede7274cb14c42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625976.696120:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.696224:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823788160 00000100:00100000:3.0:1788625976.696237:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823788160 00000100:00100000:3.0:1788625976.696307:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1788625976.696319:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+13:14479:x1875509823788160:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1788625976.696347:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625976.696371:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d048 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696457:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696473:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696486:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625976.696529:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788625976.696534:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788625976.696552:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696562:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696584:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 15 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696603:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 14 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.696638:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625976.696642:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625976.696646:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fd400, rc 0) 00000100:00100000:3.0:1788625976.696709:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14479:x1875509823788160:12345-192.168.201.45@tcp:101:bash.0 Request processed in 392us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.696716:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1788625976.702655:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.702813:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823788416 00000100:00100000:3.0:1788625976.702833:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823788416 00000100:00100000:3.0:1788625976.702915:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1788625976.702928:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14479:x1875509823788416:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1788625976.703648:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14479:x1875509823788416:12345-192.168.201.45@tcp:35:bash.0 Request processed in 717us (999us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788625976.703667:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1788625976.801342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.801482:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823788672 00000100:00100000:1.0:1788625976.801496:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823788672 00000100:00100000:1.0:1788625976.801565:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1788625976.801577:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14490:x1875509823788672:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1788625976.801608:0:16453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625976.801665:0:16453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d04f expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625976.801961:0:16453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788625976.802109:0:16453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14c65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d04f expref: 17 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.802126:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b4352039700) 00010000:00010000:1.0:1788625976.802129:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625976.802135:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1000/0x8aede7274cb14c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d04f expref: 17 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625976.802361:0:16453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e1000, rc 0) 00000100:00100000:1.0:1788625976.802513:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14490:x1875509823788672:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 937us (1184us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788625976.802521:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625976.827564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.827680:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823788928 00000100:00100000:1.0:1788625976.827697:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823788928 00000100:00100000:1.0:1788625976.827819:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1788625976.827831:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14490:x1875509823788928:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1788625976.828547:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+17:14490:x1875509823788928:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 324us (605us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788625976.828559:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1788625976.896472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625976.896605:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823789184 00000100:00100000:1.0:1788625976.896619:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823789184 00000100:00100000:1.0:1788625976.896695:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1788625976.896708:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+17:14493:x1875509823789184:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1788625976.896986:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625976.897015:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb14c73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d056 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.897274:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb14c7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.897293:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb14c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.897309:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb14c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625976.897333:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788625976.897521:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4de00/0x8aede7274cb14c73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d056 expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.897546:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb14c7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d056 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.897557:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625976.897560:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625976.897565:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d200, rc 0) 00000100:00100000:0.0:1788625976.897662:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14493:x1875509823789184:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 956us (1204us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788625976.897671:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:2.0:1788625976.907955:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625976.908059:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625976.908073:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823789440 00000100:00100000:3.0:1788625976.908088:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823789440 00000100:00100000:3.0:1788625976.908247:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:3.0:1788625976.908260:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14493:x1875509823789440:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1788625976.908330:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908359:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908371:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908432:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908440:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908446:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908452:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fc000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:3.0:1788625976.908456:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908464:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908475:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625976.908477:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625976.908482:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625976.908487:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625976.908581:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14493:x1875509823789440:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 323us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625976.908589:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1788625976.914049:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823789312 00000100:00100000:0.0:1788625976.914071:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823789312 00000100:00100000:2.0:1788625976.914874:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625976.914914:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1788625976.914932:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+19:2366:x1875509823789312:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625976.914956:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625976.914994:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d200/0x8aede7274cb14c7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d056 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625976.915020:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625976.915026:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625976.915106:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+18:2366:x1875509823789312:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 179us (7046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625976.915115:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625976.916871:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823789696 00000100:00100000:3.0:1788625976.916884:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823789696 00000100:00100000:3.0:1788625976.916957:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1788625976.916986:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14493:x1875509823789696:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1788625976.917355:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14493:x1875509823789696:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 371us (2499us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788625976.917363:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000040:00080000:1.0:1788625976.947626:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625977.328603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.328815:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823789952 00000100:00100000:3.0:1788625977.328826:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823789952 00000100:00100000:3.0:1788625977.328933:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1788625977.328942:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14525:x1875509823789952:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1788625977.328964:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625977.328983:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c8f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d05d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.329086:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14c96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.329101:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14c96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.329113:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14c96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625977.329125:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788625977.329287:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14c8f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d05d expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.329306:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14c96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d05d expref: 21 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.329332:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625977.329335:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625977.329340:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fc400, rc 0) 00000100:00100000:3.0:1788625977.329450:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14525:x1875509823789952:12345-192.168.201.45@tcp:101:cat.0 Request processed in 507us (857us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788625977.329457:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1788625977.337051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.337089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625977.337175:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823790336 00000100:00100000:0.0:1788625977.337186:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823790336 00000100:00100000:0.0:1788625977.337258:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1788625977.337271:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14525:x1875509823790336:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:0.0:1788625977.337623:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+22:14525:x1875509823790336:12345-192.168.201.45@tcp:35:cat.0 Request processed in 355us (532us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788625977.337631:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1788625977.339159:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823790080 00000100:00100000:1.0:1788625977.339172:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823790080 00000100:00100000:1.0:1788625977.339248:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1788625977.339258:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+22:2365:x1875509823790080:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625977.339272:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625977.339297:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14c96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d05d expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.339317:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:1.0:1788625977.339322:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625977.339368:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+21:2365:x1875509823790080:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 112us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625977.339375:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000001:00080000:2.0:1788625977.401117:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:2.0:1788625977.401137:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1788625977.401145:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:2.0:1788625977.401156:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788625977.417927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625977.418014:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823790592 00000100:00100000:1.0:1788625977.418025:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823790592 00000100:00100000:1.0:1788625977.418085:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1788625977.418095:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+12:14531:x1875509823790592:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1788625977.418119:0:16453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625977.418140:0:16453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14ca4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d064 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418325:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418336:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418357:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418363:0:16453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418394:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418403:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 13 pid: 14325 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625977.418426:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16453:1875509845799040:192.168.201.45@tcp:104: 00010000:00010000:1.0:1788625977.418636:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.418646:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 13 pid: 14324 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625977.418656:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16453:1875509845799168:192.168.201.45@tcp:104: 00000100:00100000:1.0:1788625977.418682:0:16453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625977.422801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625977.422830:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625977.422923:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823790720 00000100:00100000:0.0:1788625977.422933:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823790720 00010000:00010000:0.0:1788625977.422975:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 14 pid: 14325 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625977.423013:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823790848 00000100:00100000:0.0:1788625977.423017:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823790848 00010000:00010000:0.0:1788625977.423030:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 15 pid: 14324 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625977.423047:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:0.0:1788625977.423056:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434869fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:2366:x1875509823790720:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625977.423070:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625977.423078:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 15 pid: 14325 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423092:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 15 pid: 14325 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423115:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625977.423145:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423155:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423162:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625977.423222:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434869fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:2366:x1875509823790720:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 154us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625977.423238:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:0.0:1788625977.423284:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1788625977.423292:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:2366:x1875509823790848:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625977.423300:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625977.423305:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 14 pid: 14324 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423315:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 14 pid: 14324 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423326:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625977.423330:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423337:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423345:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.423362:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625977.423390:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:2366:x1875509823790848:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 98us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625977.423397:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00010000:00010000:2.0:1788625977.424819:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14c5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d048 expref: 13 pid: 14325 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625977.424856:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16453:1875509845799040:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625977.424873:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14c49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d041 expref: 12 pid: 14324 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625977.424883:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43798c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16453:1875509845799168:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625977.424910:0:16453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.424919:0:16453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.424925:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625977.424948:0:16453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788625977.425140:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1e00/0x8aede7274cb14ca4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d064 expref: 13 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.425158:0:16453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1800/0x8aede7274cb14cab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d064 expref: 12 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.425167:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:2.0:1788625977.425170:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625977.425174:0:16453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43646e1800, rc 0) 00000100:00100000:2.0:1788625977.425250:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+12:14531:x1875509823790592:12345-192.168.201.45@tcp:101:dd.0 Request processed in 7156us (7330us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788625977.425268:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1788625977.429449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625977.429617:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791104 00000100:00100000:0.0:1788625977.429628:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791104 00000100:00100000:0.0:1788625977.429691:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1788625977.429702:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+12:14531:x1875509823791104:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:1.0:1788625977.431074:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.431109:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625977.431134:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625977.431190:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788625977.431498:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a89c57d6 reply state 00000000ae79fe19 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625977.431508:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625977.431771:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14531:x1875509823791104:12345-192.168.201.45@tcp:36:dd.0 Request processed in 2068us (2329us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788625977.431781:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000020:00080000:1.0:1788625977.431787:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788625977.436775:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436795:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436803:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436810:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625977.436815:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436824:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436842:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:2.0:1788625977.436845:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625977.436851:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625977.436858:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0400/0x8aede7274cb14cb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625977.440034:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.440493:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791232 00000100:00100000:3.0:1788625977.440503:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791232 00000100:00100000:3.0:1788625977.440568:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1788625977.440579:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14531:x1875509823791232:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:3.0:1788625977.440605:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625977.440627:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14cc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d06b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.440701:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d06b expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.440716:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d06b expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.440775:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625977.440779:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625977.440797:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fc000, rc 0) 00000100:00100000:3.0:1788625977.440857:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14531:x1875509823791232:12345-192.168.201.45@tcp:101:dd.0 Request processed in 279us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.440864:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1788625977.460967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625977.461125:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791488 00000100:00100000:0.0:1788625977.461136:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791488 00000100:00100000:0.0:1788625977.461204:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1788625977.461225:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14531:x1875509823791488:12345-192.168.201.45@tcp:103:dd.0 00010000:00010000:0.0:1788625977.461249:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625977.461275:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14cc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d06b expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625977.461297:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625977.461303:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625977.461367:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14531:x1875509823791488:12345-192.168.201.45@tcp:103:dd.0 Request processed in 144us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625977.461374:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1788625977.464987:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.465111:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791616 00000100:00100000:3.0:1788625977.465121:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791616 00000100:00100000:3.0:1788625977.465188:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:3.0:1788625977.465199:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14531:x1875509823791616:12345-192.168.201.45@tcp:58:dd.0 00010000:00010000:3.0:1788625977.465321:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.465340:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.465353:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625977.466202:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625977.466362:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788625977.466450:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788625977.467175:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14531:x1875509823791616:12345-192.168.201.45@tcp:58:dd.0 Request processed in 1972us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.467186:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1788625977.472998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.473153:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791744 00000100:00100000:3.0:1788625977.473164:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791744 00000100:00100000:3.0:1788625977.473383:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:3.0:1788625977.473393:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14531:x1875509823791744:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:3.0:1788625977.473428:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625977.473453:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d072 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473529:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473542:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473561:0:14324:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473574:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473587:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:3.0:1788625977.473591:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625977.473594:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625977.473602:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fc800, rc 0) 00000100:00100000:3.0:1788625977.473668:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14531:x1875509823791744:12345-192.168.201.45@tcp:101:dd.0 Request processed in 276us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.473676:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00010000:00010000:3.0:1788625977.651775:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625977.843516:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845799296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625977.843593:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625977.843789:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799296 00000100:00100000:2.0:1788625977.843797:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799296 00000100:00100000:2.0:1788625977.844413:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625977.844425:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845799296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625977.844461:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788625977.844514:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875509845799296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625977.844521:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625977.844571:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845799680:0@lo:400:kworker.0 00000100:00100000:2.0:1788625977.844605:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625977.845393:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845799424:0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.845452:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625977.845495:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845799936:0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.845825:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845799808:0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.846426:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799424 00000100:00100000:3.0:1788625977.846436:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799424 00000100:00100000:3.0:1788625977.846486:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788625977.846494:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3309:x1875509845799424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.846545:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b37dd17e-8565-48d9-9dd1-803cb11c3fc0+19:3309:x1875509845799424:12345-0@lo:400:kworker.0 Request processed in 53us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.846553:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788625977.849217:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845799552:0@lo:400:kworker.0 00000100:00100000:1.0:1788625977.849296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625977.849358:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625977.852029:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799552 00000100:00100000:3.0:1788625977.852042:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799552 00000100:00100000:3.0:1788625977.852126:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625977.852138:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845799552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.852249:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845799552:12345-0@lo:400:kworker.0 Request processed in 114us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.852256:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788625977.853483:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625977.853541:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845799552:0@lo:400:kworker.0 00000100:00100000:2.0:1788625977.856770:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799680 00000100:00100000:2.0:1788625977.856794:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799680 00000100:00100000:2.0:1788625977.856856:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625977.856866:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845799680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625977.856952:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875509845799680:12345-0@lo:400:kworker.0 Request processed in 87us (12345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625977.856959:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625977.857010:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875509845799680:0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.857888:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625977.857947:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b37dd17e-8565-48d9-9dd1-803cb11c3fc0:3309:1875509845799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788625977.859337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625977.859415:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875509845799296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625977.859540:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799936 00000100:00100000:3.0:1788625977.859547:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799936 00000100:00100000:3.0:1788625977.859605:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845799808 00000100:00100000:3.0:1788625977.859608:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845799808 00000100:00100000:3.0:1788625977.859630:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625977.859645:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845799936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.859710:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875509845799936:12345-0@lo:400:kworker.0 Request processed in 73us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.859716:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625977.859758:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625977.859764:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845799808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625977.859991:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875509845799808:12345-0@lo:400:kworker.0 Request processed in 227us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.859998:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625977.860028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875509845799936:0@lo:400:kworker.0 00000100:00080000:1.0:1788625977.860390:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625977.860421:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875509845799808:0@lo:400:kworker.0 00000040:00080000:1.0:1788625977.974999:0:14355:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625977.975024:0:14355:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625977.975068:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788625977.975075:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788625977.975203:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14355:1875509845800064:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625977.975319:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db21900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625977.980478:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14355:1875509845800064:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625977.994133:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625977.994482:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823791872 00000100:00100000:3.0:1788625977.994493:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823791872 00000100:00100000:3.0:1788625977.994552:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625977.994563:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823791872:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788625977.994656:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823791872:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 94us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625977.994664:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1788625978.002083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.002179:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823792000 00000100:00100000:3.0:1788625978.002190:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823792000 00000100:00100000:3.0:1788625978.002272:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:3.0:1788625978.002284:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823792000:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788625978.002319:0:14324:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1788625978.002542:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625978.002712:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823792000:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 430us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625978.002721:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1788625978.017140:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.017236:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823792128 00000100:00100000:1.0:1788625978.017247:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823792128 00000100:00100000:1.0:1788625978.017306:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:1.0:1788625978.017318:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823792128:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788625978.017389:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017422:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017436:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017452:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017459:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017465:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017487:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017510:0:16453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017517:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625978.017555:0:16453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788625978.017560:0:16453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788625978.017575:0:16453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017584:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017590:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017597:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017602:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.017606:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017613:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017624:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b4352039200) 00010000:00010000:1.0:1788625978.017628:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625978.017632:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017660:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14cd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017673:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017679:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017685:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017690:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.017693:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017699:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017707:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b436f250700) 00010000:00010000:1.0:1788625978.017709:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625978.017712:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017717:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14cdc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017767:0:16453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017774:0:16453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017785:0:16453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017790:0:16453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.017793:0:16453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017799:0:16453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017808:0:16453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:1.0:1788625978.017811:0:16453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625978.017814:0:16453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.017819:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e1400/0x8aede7274cb14ce3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.017901:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823792128:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 584us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625978.017908:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1788625978.039242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.039392:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823792384 00000100:00100000:0.0:1788625978.039420:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823792384 00000100:00100000:0.0:1788625978.039481:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:0.0:1788625978.039491:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823792384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625978.039512:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625978.039546:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14cea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d079 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039660:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039674:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039686:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625978.039697:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788625978.039835:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039844:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039850:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039856:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625978.039861:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039869:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039881:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:0.0:1788625978.039884:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788625978.039888:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039905:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14cf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039950:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14cea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d079 expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039961:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b4352039200) 00010000:00010000:0.0:1788625978.039963:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625978.039967:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14cea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d079 expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.039976:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c000, rc 0) 00000100:00100000:0.0:1788625978.040037:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14532:x1875509823792384:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 547us (805us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788625978.040044:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1788625978.049955:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.051593:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823792512 00000100:00100000:1.0:1788625978.051606:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823792512 00000100:00100000:1.0:1788625978.051931:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1788625978.051944:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14532:x1875509823792512:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788625978.051982:0:16453:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788625978.052099:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14532:x1875509823792512:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 157us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625978.052124:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1788625978.056170:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.056422:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823792768 00000100:00100000:0.0:1788625978.056432:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823792768 00000100:00100000:0.0:1788625978.056490:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1788625978.056501:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+16:14532:x1875509823792768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625978.056632:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625978.056723:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14cff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d080 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625978.060146:0:14326:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788625978.060157:0:14326:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788625978.060422:0:14326:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788625978.062209:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14d06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.062247:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.062260:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.062333:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14cff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d080 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.062354:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14d06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d080 expref: 18 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.062365:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4345245300) 00010000:00010000:0.0:1788625978.062368:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625978.062371:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4cc00, rc 0) 00000100:00100000:0.0:1788625978.062521:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823792768:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 6021us (6360us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788625978.062531:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:3.0:1788625978.070412:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625978.070481:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793024 00000100:00100000:2.0:1788625978.070491:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793024 00000100:00100000:2.0:1788625978.070562:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1788625978.070572:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823793024:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625978.070641:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625978.070669:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4cc00/0x8aede7274cb14d06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d080 expref: 18 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.070700:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4345245300) 00010000:00010000:2.0:1788625978.070712:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625978.070780:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.070793:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.070801:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.070816:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.070823:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.071311:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072021:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072031:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072037:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072043:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94b000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625978.072048:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072062:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072074:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b4352039000) 00010000:00010000:2.0:1788625978.072077:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625978.072082:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072087:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94b000/0x8aede7274cb14d14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072097:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072102:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072107:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072111:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:2.0:1788625978.072114:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072119:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072124:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7a5ca141 (ffff9b4356b43a00) 00010000:00010000:2.0:1788625978.072126:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625978.072129:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.072143:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d1b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7a5ca141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.072295:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+17:14532:x1875509823793024:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1722us (1902us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625978.072304:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1788625978.079592:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.079643:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793152 00000100:00100000:3.0:1788625978.079653:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793152 00000100:00100000:3.0:1788625978.079710:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1788625978.079721:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+17:14532:x1875509823793152:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625978.079792:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625978.079816:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd200/0x8aede7274cb14d22 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d087 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079853:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14d29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079865:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14d29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079875:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14d29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079967:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd200/0x8aede7274cb14d22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d087 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079986:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc000/0x8aede7274cb14d29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d087 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.079995:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:3.0:1788625978.079998:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788625978.080001:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fc000, rc 0) 00000100:00100000:3.0:1788625978.080061:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823793152:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 342us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625978.080068:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1788625978.097047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.103379:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793408 00000100:00100000:1.0:1788625978.103396:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793408 00000100:00100000:2.0:1788625978.103530:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1788625978.103545:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823793408:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625978.103697:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.103716:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.103754:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625978.104484:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788625978.104496:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528100767053ns, next at 529100764476ns, rc = 0 00000004:00010000:2.0:1788625978.104669:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e21efdc2 reply state 00000000c9d49920 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.104679:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625978.105441:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14532:x1875509823793408:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1895us (8399us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788625978.105451:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00010000:00010000:1.0:1788625978.116133:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116153:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116162:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116169:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.116175:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116184:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116202:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:1.0:1788625978.116206:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788625978.116211:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.116218:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b434f94a200/0x8aede7274cb14d30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.122910:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.125819:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793536 00000100:00100000:0.0:1788625978.125836:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793536 00000100:00100000:0.0:1788625978.125918:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1788625978.125929:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+19:14532:x1875509823793536:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625978.125953:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625978.125976:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d08e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.126039:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.126069:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.126089:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:0.0:1788625978.126092:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625978.126096:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4c000, rc 0) 00000100:00100000:0.0:1788625978.126173:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14532:x1875509823793536:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 245us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.126181:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1788625978.141868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.141965:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793664 00000100:00100000:1.0:1788625978.141976:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793664 00000100:00100000:1.0:1788625978.142053:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1788625978.142065:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2366:x1875509823793664:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788625978.142933:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2366:x1875509823793664:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 867us (1073us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788625978.142944:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00080000:0.0:1788625978.143659:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625978.151614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.151764:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823793920 00000100:00100000:0.0:1788625978.151786:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823793920 00000100:00100000:0.0:1788625978.151848:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1788625978.151859:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14532:x1875509823793920:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625978.152099:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14532:x1875509823793920:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 240us (494us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788625978.152108:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1788625978.159664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.160076:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794176 00000100:00100000:0.0:1788625978.160088:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794176 00000100:00100000:0.0:1788625978.160161:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1788625978.160173:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14532:x1875509823794176:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788625978.160319:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14532:x1875509823794176:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 147us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.160327:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1788625978.179249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.179627:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794304 00000100:00100000:0.0:1788625978.179637:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794304 00000100:00100000:0.0:1788625978.179702:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:0.0:1788625978.179713:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+21:14532:x1875509823794304:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625978.179753:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625978.179905:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14d3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d095 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.179974:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.179989:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.180001:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625978.180037:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788625978.180056:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.180080:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4ce00/0x8aede7274cb14d3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d095 expref: 23 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.180097:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d095 expref: 22 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.180105:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:0.0:1788625978.180108:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788625978.180112:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b4379c4d400, rc 0) 00000100:00100000:0.0:1788625978.180194:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+22:14532:x1875509823794304:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 482us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.182916:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1788625978.188092:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625978.188182:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794432 00000100:00100000:2.0:1788625978.188192:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794432 00000100:00100000:2.0:1788625978.188676:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625978.188687:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+6:2366:x1875509823794432:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625978.188705:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625978.188767:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d09c expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625978.189091:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c443a, blocks: 0x1 00010000:00010000:2.0:1788625978.189113:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788625978.189117:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.189127:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 7 pid: 15007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.189149:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 7 pid: 15007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.189163:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b434f94a000, rc 0) 00000100:00100000:2.0:1788625978.189238:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2366:x1875509823794432:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 553us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625978.189246:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1788625978.194456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.200414:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794688 00000100:00100000:0.0:1788625978.200431:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794688 00000100:00100000:0.0:1788625978.200562:0:16453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1788625978.200573:0:16453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+22:14532:x1875509823794688:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788625978.200716:0:16453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+22:14532:x1875509823794688:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 144us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.200723:0:16453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1788625978.212161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.212447:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794816 00000100:00100000:0.0:1788625978.212457:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794816 00000100:00100000:0.0:1788625978.212520:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:0.0:1788625978.212532:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+22:14532:x1875509823794816:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788625978.283990:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788625978.284028:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788625978.284173:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625978.284195:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4342c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788625978.284435:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14532:x1875509823794816:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 71898us (72279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.284446:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1788625978.284525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625978.284577:0:16337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845800192 00000100:00100000:0.0:1788625978.284584:0:16337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845800192 00000100:00100000:3.0:1788625978.293210:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.293334:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823794944 00000100:00100000:1.0:1788625978.293344:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823794944 00000100:00100000:3.0:1788625978.293637:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625978.293665:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875509845800192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788625978.293933:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788625978.293937:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788625978.293939:0:15009:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788625978.293941:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788625978 -> 1788625978 00002000:00010000:0.0:1788625978.293943:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788625978.294010:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875509845800192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 348us (9484us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788625978.294026:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788625978.294102:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b4342c73b80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788625978.294109:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4342c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875509845800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788625978.296495:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1788625978.296518:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43805cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2366:x1875509823794944:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788625978.296686:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43805cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2366:x1875509823794944:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 180us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625978.296694:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1788625978.301342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.301423:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795200 00000100:00100000:3.0:1788625978.301434:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795200 00000100:00100000:1.0:1788625978.302507:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1788625978.302524:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14532:x1875509823795200:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625978.302582:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625978.302609:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4d400/0x8aede7274cb14d45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d095 expref: 14 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.302628:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:1.0:1788625978.302633:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625978.302664:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.302679:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.302688:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625978.302930:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000340e474c reply state 000000008826f957 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.302940:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625978.303039:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+15:14532:x1875509823795200:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 520us (1705us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788625978.303047:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00010000:00010000:0.0:1788625978.304941:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.304954:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.304961:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.304967:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0000 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:0.0:1788625978.304971:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.304978:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.304991:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:0.0:1788625978.304994:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625978.304998:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.305003:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0000/0x8aede7274cb14d53 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.307818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.308383:0:16337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795328 00000100:00100000:3.0:1788625978.308402:0:16337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795328 00000100:00100000:3.0:1788625978.308475:0:16337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1788625978.308485:0:16337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+7:14532:x1875509823795328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625978.308503:0:16337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625978.308521:0:16337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x45b799c765d7d0a3 expref: -99 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.308550:0:16337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.308559:0:16337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625978.308563:0:16337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625978.308569:0:16337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 8 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.308603:0:16337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.308618:0:16337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625978.308631:0:16337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16337:1875509845800320:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625978.308762:0:16337:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625978.312488:0:16337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16337:1875509845800320:192.168.201.45@tcp:104: 00010000:00010000:2.0:1788625978.312527:0:16337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 8 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.312550:0:16337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b43413fd200, rc 0) 00000100:00100000:2.0:1788625978.312610:0:16337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+8:14532:x1875509823795328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4126us (4800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625978.312619:0:16337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1788625978.313598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.313667:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795456 00000100:00100000:3.0:1788625978.313674:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795456 00010000:00010000:3.0:1788625978.313709:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.313850:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1788625978.313861:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+8:2366:x1875509823795456:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625978.313875:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625978.313898:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.313922:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.313946:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057cb033b/0x8aede7274cb14d4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d09c expref: 8 pid: 15007 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.313966:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625978.313970:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625978.313977:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 7 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.313987:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 7 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.314022:0:14310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 7 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.314037:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14310:1875509845800448:192.168.201.45@tcp:105: 00000100:00100000:0.0:1788625978.314112:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b43480a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625978.320799:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b437f962300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14310:1875509845800448:192.168.201.45@tcp:105: 00010000:00010000:3.0:1788625978.320831:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625978.320885:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2366:x1875509823795456:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 7026us (7289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625978.320895:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1788625978.326496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.326621:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795584 00000100:00100000:1.0:1788625978.326632:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795584 00000100:00100000:1.0:1788625978.326691:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1788625978.326702:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2366:x1875509823795584:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788625978.326910:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788625978.326913:0:15010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788625977 00002000:00010000:1.0:1788625978.326915:0:15010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788625976 00002000:00010000:1.0:1788625978.326917:0:15010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788625978 -> 1788625977 00002000:00010000:1.0:1788625978.326918:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788625978.326964:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+8:2366:x1875509823795584:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 265us (478us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788625978.326969:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:0.0:1788625978.341645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625978.346636:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795712 00000100:00100000:2.0:1788625978.346653:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795712 00000100:00100000:2.0:1788625978.346743:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625978.346753:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+8:2365:x1875509823795712:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788625978.346801:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.346840:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 8 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.346849:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.346854:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625978.346859:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.346894:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 8 pid: 16337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.346908:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 8 pid: 16337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.346923:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15007:1875509845800576:192.168.201.45@tcp:104: 00000100:00100000:2.0:1788625978.347004:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4351d91780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625978.349789:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15007:1875509845800576:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625978.349818:0:15007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.354605:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.355198:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823795840 00000100:00100000:1.0:1788625978.355209:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823795840 00010000:00010000:1.0:1788625978.355261:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 9 pid: 16337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.355306:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1788625978.355317:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+9:2365:x1875509823795840:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625978.355351:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625978.355375:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 9 pid: 16337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.355390:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 9 pid: 16337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.355575:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067aa2ce8/0x8aede7274cb14d5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d0a3 expref: 9 pid: 16337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.355592:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625978.355596:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625978.355602:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.355613:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.355684:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625978.355765:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+8:2365:x1875509823795840:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 448us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625978.355773:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00010000:00010000:0.0:1788625978.358547:0:15007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358588:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358622:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358631:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358640:0:15007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358646:0:15007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a800 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625978.358650:0:15007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358659:0:15007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358677:0:15007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.358685:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf7a7d3/0x8aede7274cb14d61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.358924:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+7:2365:x1875509823795712:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 12168us (17284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.358935:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1788625978.363875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.364008:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796096 00000100:00100000:3.0:1788625978.364018:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796096 00000100:00100000:3.0:1788625978.364075:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:3.0:1788625978.364085:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:14532:x1875509823796096:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788625978.364171:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364190:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364212:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364489:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364501:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364510:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364545:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.364561:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 15 pid: 14326 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625978.364574:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845800704:192.168.201.45@tcp:104: 00000100:00100000:3.0:1788625978.364659:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625978.370523:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845800704:192.168.201.45@tcp:104: 00010000:00010000:3.0:1788625978.370557:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.374477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.374537:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796224 00000100:00100000:3.0:1788625978.374547:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796224 00010000:00010000:3.0:1788625978.374587:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 16 pid: 14326 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625978.374632:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1788625978.374655:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+16:2365:x1875509823796224:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625978.374670:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625978.374676:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 16 pid: 14326 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.374846:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 16 pid: 14326 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.374868:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b4379c4c000/0x8aede7274cb14d37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d08e expref: 16 pid: 14326 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.374884:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:3.0:1788625978.374889:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.374982:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.374990:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.375093:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625978.375153:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+15:2365:x1875509823796224:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 499us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625978.375161:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:3.0:1788625978.375389:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.375408:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625978.375595:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788625978.375784:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788625978.375826:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788625978.375921:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b4345f3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1875509845800832:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625978.376005:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625978.376038:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435058b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625978.376179:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845800832 00000100:00100000:0.0:1788625978.376186:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845800832 00000100:00100000:0.0:1788625978.376235:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625978.376243:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1875509845800832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788625978.376325:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1875509845800832:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625978.376332:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625978.376483:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b4345f3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1875509845800832:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788625978.377148:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788625978.377220:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1875509845800960:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788625978.377269:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625978.377299:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b435db219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625978.377636:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845800960 00000100:00100000:2.0:1788625978.377643:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845800960 00000100:00100000:2.0:1788625978.377674:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625978.377682:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1875509845800960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788625978.377904:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14324:x1875509845800960:12345-0@lo:1000:mdt00_000.0 Request processed in 222us (634us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788625978.377918:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625978.378855:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1875509845800960:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788625978.378896:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378906:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378913:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378918:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fd400 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.378922:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378930:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378944:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:1.0:1788625978.378948:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625978.378953:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378958:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fd400/0x8aede7274cb14d6f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378990:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.378996:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379011:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379015:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fda00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.379018:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379023:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379031:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:1.0:1788625978.379033:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625978.379039:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379050:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379059:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.379088:0:14324:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc800/0x8aede7274cb14cce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x45b799c765d7d072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.379103:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b43801fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845801088:192.168.201.45@tcp:105: 00000100:00100000:1.0:1788625978.379182:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b4347ce4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625978.385137:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b43801fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1875509845801088:192.168.201.45@tcp:105: 00010000:00010000:1.0:1788625978.385192:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385314:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fda00/0x8aede7274cb14cc7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385358:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385372:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385384:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385405:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385420:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385427:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385432:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e0c00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.385436:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385443:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385455:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:1.0:1788625978.385465:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625978.385470:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385476:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43646e0c00/0x8aede7274cb14d76 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385486:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385492:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385499:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385504:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fce00 already unused, calling callback (ffffffffc20994f0) 00010000:00010000:1.0:1788625978.385507:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385512:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385520:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b4352039f00) 00010000:00010000:1.0:1788625978.385522:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625978.385524:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625978.385529:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fce00/0x8aede7274cb14d68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.385879:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823796096:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 21792us (22008us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788625978.385901:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000020:00080000:1.0:1788625978.385908:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788625978.392926:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.393384:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796480 00000100:00100000:3.0:1788625978.393411:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796480 00000100:00100000:3.0:1788625978.393478:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1788625978.393490:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43451ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+18:14532:x1875509823796480:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788625978.395132:0:14328:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788625978.395253:0:14328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788625978.395301:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395318:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395330:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395338:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395345:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395352:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.395367:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625978.395539:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625978.395548:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.395555:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fc400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625978.395559:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.395567:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.395580:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b4352039100) 00010000:00010000:0.0:1788625978.395582:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788625978.395587:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.395600:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b43413fc400/0x8aede7274cb14d7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.395612:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625978.395614:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625978.395616:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625978.396620:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43451ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14532:x1875509823796480:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 3125us (3695us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788625978.396632:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000020:00080000:3.0:1788625978.396647:0:14328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788625978.397238:0:14355:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788625978.397243:0:14355:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625978.397273:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788625978.397279:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788625978.402595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.407141:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796608 00000100:00100000:3.0:1788625978.407155:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796608 00000100:00100000:3.0:1788625978.407247:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1788625978.407258:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14531:x1875509823796608:12345-192.168.201.45@tcp:49:dd.0 00000100:00100000:3.0:1788625978.407411:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+20:14531:x1875509823796608:12345-192.168.201.45@tcp:49:dd.0 Request processed in 155us (4826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625978.407419:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:0.0:1788625978.618137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.618183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625978.618299:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796736 00000100:00100000:3.0:1788625978.618311:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796736 00000100:00100000:3.0:1788625978.618422:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796864 00000100:00100000:3.0:1788625978.618426:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796864 00000100:00100000:3.0:1788625978.618450:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1788625978.618461:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+8:2366:x1875509823796736:12345-192.168.201.45@tcp:4:dd.0 00002000:00010000:3.0:1788625978.618512:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c4439, atime: 0x6a9c4438, ctime: 0x6a9c4439, blocks: 0x1 00010000:00010000:3.0:1788625978.618522:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.618539:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788625978.618544:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625978.618552:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.618569:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625978.626404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1788625978.631932:0:15014:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625978.631951:0:15014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788625978.634002:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823796992 00000100:00100000:1.0:1788625978.634014:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823796992 00000100:00100000:2.0:1788625978.634532:0:16554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1788625978.634545:0:16554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+10:2366:x1875509823796864:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1788625978.634581:0:16554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.634599:0:16554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.634603:0:16554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.634610:0:16554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.634633:0:16554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.674986:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625978.761818:0:15013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1788625978.761832:0:15013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788625977 -> 1788625978 00002000:00010000:0.0:1788625978.761836:0:15013:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1788625978.761856:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761873:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761885:0:15013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761893:0:15013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43413fcc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625978.761899:0:15013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761911:0:15013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761965:0:15013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.761974:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ea4067/0x8aede7274cb14d84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.762103:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43798c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+14:2366:x1875509823796736:12345-192.168.201.45@tcp:4:dd.0 Request processed in 143636us (143969us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788625978.762122:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1788625978.762167:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1788625978.762181:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+13:2365:x1875509823796992:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:0.0:1788625978.762239:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.762255:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625978.762261:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625978.762269:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.762283:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763112:0:16554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763138:0:16554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763146:0:16554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763153:0:16554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:3.0:1788625978.763157:0:16554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763165:0:16554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763179:0:16554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625978.763243:0:16554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14d8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625978.763326:0:16554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:48479f8b-3181-4d66-9752-cb1b70d3443c+13:2366:x1875509823796864:12345-192.168.201.45@tcp:4:dd.0 Request processed in 128781us (145139us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788625978.763336:0:16554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000001:00080000:3.0:1788625978.765486:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1788625978.765519:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1788625978.765530:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788625978.765568:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788625978.846660:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788625978.850021:0:15013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788625978.850036:0:15013:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788625978.850055:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850097:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850107:0:15013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850114:0:15013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625978.850121:0:15013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850134:0:15013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850160:0:15013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.850169:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625978.850326:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2365:x1875509823796992:12345-192.168.201.45@tcp:4:dd.0 Request processed in 88141us (223935us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788625978.850338:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:1.0:1788625978.868197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.868249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.868283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.868314:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1788625978.868339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1788625978.868465:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797120 00000100:00100000:0.0:1788625978.868479:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797120 00000100:00100000:0.0:1788625978.868549:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797248 00000100:00100000:0.0:1788625978.868553:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797248 00000100:00100000:2.0:1788625978.868561:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797504 00000100:00100000:2.0:1788625978.868566:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797504 00000100:00100000:0.0:1788625978.868588:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797376 00000100:00100000:2.0:1788625978.868589:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797632 00000100:00100000:2.0:1788625978.868591:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797632 00000100:00100000:0.0:1788625978.868591:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797376 00000100:00100000:0.0:1788625978.868608:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1788625978.868638:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+9:2365:x1875509823797120:12345-192.168.201.45@tcp:4:dd.0 00002000:00010000:0.0:1788625978.868722:0:15015:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c443a, atime: 0x6a9c4438, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788625978.868771:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.868792:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788625978.868797:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625978.868806:0:15015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625978.868825:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625978.868837:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1788625978.868846:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+9:2365:x1875509823797248:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1788625978.868866:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.868883:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.868885:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625978.868889:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625978.868899:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625979.001950:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:0.0:1788625979.001959:0:15014:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788625978 00002000:00010000:0.0:1788625979.001962:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788625979.001978:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.001991:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.002000:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.002026:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b434f94a200 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625979.002031:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.002040:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.002060:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.002069:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074a5f82c/0x8aede7274cb14da0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625979.002176:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+14:2365:x1875509823797248:12345-192.168.201.45@tcp:4:dd.0 Request processed in 133326us (133920us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788625979.002197:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000001:00080000:3.0:1788625979.004533:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000100:00100000:0.0:1788625979.004745:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1788625979.004779:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+11:2366:x1875509823797504:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:0.0:1788625979.004824:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.004841:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788625979.004847:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625979.004853:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.004888:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625979.070827:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1788625979.073270:0:15015:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1788625979.073279:0:15015:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788625979.073293:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073307:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073317:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073323:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4d400 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625979.073328:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073338:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073357:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073364:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d346fc3d/0x8aede7274cb14d99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625979.073489:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+11:2365:x1875509823797120:12345-192.168.201.45@tcp:4:dd.0 Request processed in 204866us (205310us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788625979.073500:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1788625979.073536:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1788625979.073548:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+10:2365:x1875509823797632:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:0.0:1788625979.073581:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073593:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625979.073598:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625979.073604:0:15015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.073616:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625979.147835:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788625979.160497:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788625979.160507:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788625979.160523:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160537:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160546:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160553:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4cc00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:1.0:1788625979.160558:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160588:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160611:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.160692:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf076a4/0x8aede7274cb14da7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625979.160983:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+10:2366:x1875509823797504:12345-192.168.201.45@tcp:4:dd.0 Request processed in 156218us (292692us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788625979.160998:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1788625979.161036:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1788625979.161057:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+9:2365:x1875509823797376:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:1.0:1788625979.161098:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.161111:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625979.161116:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625979.161122:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625979.161134:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226010:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226030:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226040:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226060:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b4379c4de00 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:2.0:1788625979.226065:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226081:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226106:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625979.226133:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a86c3aa/0x8aede7274cb14dae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625979.226246:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48479f8b-3181-4d66-9752-cb1b70d3443c+11:2365:x1875509823797632:12345-192.168.201.45@tcp:4:dd.0 Request processed in 152697us (357901us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788625979.226543:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000001:00080000:2.0:1788625979.227055:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:1.0:1788625979.313808:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1788625979.313978:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788625979.313996:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314009:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314019:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314046:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b43646e1600 already unused, calling callback (ffffffffc16554f0) 00010000:00010000:0.0:1788625979.314051:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314190:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314373:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625979.314457:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004957e5f9/0x8aede7274cb14db5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625979.314561:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b43801ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2365:x1875509823797376:12345-192.168.201.45@tcp:4:dd.0 Request processed in 153512us (446241us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788625979.314571:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00010000:00010000:0.0:1788625979.699068:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625980.065382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065490:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065574:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1788625980.065634:0:16453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823798272 00000100:00100000:3.0:1788625980.065648:0:16453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823798272 00000100:00100000:2.0:1788625980.066295:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797760 00000100:00100000:2.0:1788625980.066304:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797760 00000100:00100000:2.0:1788625980.066353:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1788625980.066374:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b434fdf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2366:x1875509823797760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066465:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b434fdf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5be9537b-fe13-4af9-884b-2c4cda6cee72+13:2366:x1875509823797760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 104us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066473:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1788625980.066542:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823798016 00000100:00100000:2.0:1788625980.066547:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823798016 00000100:00100000:2.0:1788625980.066574:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823798528 00000100:00100000:2.0:1788625980.066577:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823798528 00000100:00100000:2.0:1788625980.066591:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823798144 00000100:00100000:2.0:1788625980.066593:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823798144 00000100:00100000:2.0:1788625980.066605:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823798400 00000100:00100000:2.0:1788625980.066608:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823798400 00000100:00100000:2.0:1788625980.066622:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1788625980.066628:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2366:x1875509823798016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066661:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2366:x1875509823798016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066690:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1788625980.066704:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1788625980.066710:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2366:x1875509823798528:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066772:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b437f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2366:x1875509823798528:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 62us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066779:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1788625980.066791:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625980.066796:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2366:x1875509823798144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066815:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48479f8b-3181-4d66-9752-cb1b70d3443c+5:2366:x1875509823798144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 19us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066821:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1788625980.066829:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625980.066834:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2366:x1875509823798400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066851:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4342c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eff845-5876-4960-81d4-b2d1a5f68f7f+5:2366:x1875509823798400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 17us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066857:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1788625980.066880:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509823797888 00000100:00100000:2.0:1788625980.066884:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509823797888 00000100:00100000:2.0:1788625980.066909:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625980.066916:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4345f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2366:x1875509823798272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.066951:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4345f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eff845-5876-4960-81d4-b2d1a5f68f7f+6:2366:x1875509823798272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.066957:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1788625980.066981:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:2.0:1788625980.066987:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+20:2366:x1875509823797888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1788625980.067017:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b4379975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48479f8b-3181-4d66-9752-cb1b70d3443c+20:2366:x1875509823797888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.067023:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00080000:2.0:1788625980.067061:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625980.067065:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625980.067068:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625980.403970:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625980.404003:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b436ea0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845801216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625980.404117:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625980.404206:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509845801216 00000100:00100000:2.0:1788625980.404217:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509845801216 00000100:00100000:2.0:1788625980.404305:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625980.404317:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b436ea0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845801216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625980.404383:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788625980.404437:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b436ea0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875509845801216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625980.404445:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788625980.404472:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625980.404505:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788625980.404511:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b4342c73b80, transno 8589934595 00000004:00080000:2.0:1788625980.404523:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788625980.404558:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b436ea0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875509845801216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788625980.724697:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625980.899660:0:16592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1788625981.492168:0:14355:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788625981.492183:0:14355:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625981.492227:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788625981.492254:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788625981.749448:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625982.771930:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29887 lines, 29887 kept, 0 dropped, 0 bad.